2023-09-28T00:05:18.313 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T00:05:18.313 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493 --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/orig.config.yaml 2023-09-28T00:05:18.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T00:05:18.502 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493 branch: wip-yuri-testing-2023-09-27-0906-quincy description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} email: yweinste@redhat.com first_in_suite: false job_id: '7403493' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-09-27-0906-quincy ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-09-27-0906-quincy sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 3538 sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri-testing-2023-09-27-0906-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk+ADokjofcaAQ15aDVZR0SzTmNR+UFOQ9q5paoIYLZ6U59fptFsVBISPwCOiYvrLFgk3dVakmnDO6f++/la4g= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoY1tr6orhKPGlK6PizELJ1WN+qAsxT1pCaJnEHgjiNVpuw09qV9ZhKEsEdkxLImgVvqsGtPcbyyc2wT85wl5M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-27_19:23:53 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-28T00:05:18.503 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa; will attempt to use it 2023-09-28T00:05:18.503 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks 2023-09-28T00:05:18.503 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-28T00:05:18.505 INFO:teuthology.task.internal:Checking packages... 2023-09-28T00:05:18.531 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28' 2023-09-28T00:05:18.531 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-28T00:05:18.532 INFO:teuthology.packaging:ref: None 2023-09-28T00:05:18.532 INFO:teuthology.packaging:tag: None 2023-09-28T00:05:18.532 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-09-27-0906-quincy 2023-09-28T00:05:18.532 INFO:teuthology.packaging:sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:05:18.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-09-27-0906-quincy 2023-09-28T00:05:18.743 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1161.g471b6dfd 2023-09-28T00:05:18.743 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-28T00:05:18.748 INFO:teuthology.task.internal:no buildpackages task found 2023-09-28T00:05:18.748 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-28T00:05:18.793 INFO:teuthology.task.internal:Saving configuration 2023-09-28T00:05:18.811 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-28T00:05:18.835 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T00:05:18.862 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:59:41.009972', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk+ADokjofcaAQ15aDVZR0SzTmNR+UFOQ9q5paoIYLZ6U59fptFsVBISPwCOiYvrLFgk3dVakmnDO6f++/la4g='} 2023-09-28T00:05:18.884 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:59:41.008611', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoY1tr6orhKPGlK6PizELJ1WN+qAsxT1pCaJnEHgjiNVpuw09qV9ZhKEsEdkxLImgVvqsGtPcbyyc2wT85wl5M='} 2023-09-28T00:05:18.885 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-28T00:05:18.895 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-09-28T00:05:18.895 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-09-28T00:05:18.895 INFO:teuthology.run_tasks:Running task console_log... 2023-09-28T00:05:19.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff58e877b80>, signals=[15]) 2023-09-28T00:05:19.007 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-28T00:05:19.023 INFO:teuthology.task.internal:Opening connections... 2023-09-28T00:05:19.024 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:05:19.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:05:19.092 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:05:19.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:05:19.165 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-28T00:05:19.172 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-09-28T00:05:19.191 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-09-28T00:05:19.191 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-09-28T00:05:19.248 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T00:05:19.248 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T00:05:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T00:05:19.250 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T00:05:19.250 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T00:05:19.250 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:05:19.250 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T00:05:19.250 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T00:05:19.250 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T00:05:19.251 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T00:05:19.251 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-09-28T00:05:19.283 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-09-28T00:05:19.300 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-09-28T00:05:19.300 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-09-28T00:05:19.360 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T00:05:19.360 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T00:05:19.360 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-09-28T00:05:19.360 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.4" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T00:05:19.361 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:05:19.362 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T00:05:19.362 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T00:05:19.362 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T00:05:19.362 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T00:05:19.362 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-09-28T00:05:19.382 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-28T00:05:19.434 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-28T00:05:19.456 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-28T00:05:19.456 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2023-09-28T00:05:19.459 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-09-28T00:05:19.475 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-28T00:05:19.499 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-28T00:05:19.499 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2023-09-28T00:05:19.517 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-09-28T00:05:19.531 INFO:teuthology.orchestra.run.smithi053.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-09-28T00:05:19.534 INFO:teuthology.orchestra.run.smithi118.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-09-28T00:05:19.535 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-28T00:05:19.601 INFO:teuthology.run_tasks:Running task kernel... 2023-09-28T00:05:19.625 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-09-28T00:05:19.625 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-09-28T00:05:19.625 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-09-28T00:05:19.626 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T00:05:19.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:05:19.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-28T00:05:19.890 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-28T00:05:19.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-28T00:05:19.890 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-09-28T00:05:19.908 INFO:teuthology.orchestra.run.smithi053.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-09-28T00:05:19.908 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-28T00:05:19.908 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-28T00:05:19.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum upgrade -y linux-firmware 2023-09-28T00:05:21.325 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-28T00:05:21.326 INFO:teuthology.orchestra.run.smithi053.stdout:Unable to read consumer identity 2023-09-28T00:05:22.837 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-09-28T00:05:23.484 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-09-28T00:05:27.029 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-09-28T00:05:27.926 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-09-28T00:05:27.927 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2023-09-28T00:05:27.927 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-09-28T00:05:28.024 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-28T00:05:28.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-28T00:05:28.174 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-28T00:05:28.175 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-28T00:05:28.177 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi053.front.sepia.ceph.com to complete... 2023-09-28T00:05:41.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28 00:05:41 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-28T00:05:41.004 INFO:teuthology.orchestra.run.smithi053.stderr:FINISHED --2023-09-28 00:05:41-- 2023-09-28T00:05:41.004 INFO:teuthology.orchestra.run.smithi053.stderr:Total wall clock time: 13s 2023-09-28T00:05:41.004 INFO:teuthology.orchestra.run.smithi053.stderr:Downloaded: 1 files, 363M in 13s (28.9 MB/s) 2023-09-28T00:05:41.005 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-28T00:05:41.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-28T00:05:42.821 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying... ######################################## 2023-09-28T00:05:43.230 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing... ######################################## 2023-09-28T00:05:43.365 INFO:teuthology.orchestra.run.smithi053.stdout:Updating / installing... 2023-09-28T00:06:23.903 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-28T00:06:44.682 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-28T00:06:44.683 DEBUG:teuthology.orchestra.run.smithi053:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-28T00:06:44.741 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.741 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.741 INFO:teuthology.orchestra.run.smithi053.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.741 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-28T00:06:44.742 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-28T00:06:44.743 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-28T00:06:44.744 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-28T00:06:44.745 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-28T00:06:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-28T00:06:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-28T00:06:44.748 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-28T00:06:44.749 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-28T00:06:44.750 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-28T00:06:44.751 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-28T00:06:44.752 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-28T00:06:44.753 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-28T00:06:44.754 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-28T00:06:44.755 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-28T00:06:44.756 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-28T00:06:44.757 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-28T00:06:44.758 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-28T00:06:44.759 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-28T00:06:44.760 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-28T00:06:44.761 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-28T00:06:44.762 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-28T00:06:44.763 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-28T00:06:44.764 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-28T00:06:44.765 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-28T00:06:44.766 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-28T00:06:44.767 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-28T00:06:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-28T00:06:44.769 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-28T00:06:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-28T00:06:44.771 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-28T00:06:44.772 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-28T00:06:44.773 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-28T00:06:44.774 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-28T00:06:44.775 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-28T00:06:44.776 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-28T00:06:44.777 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-28T00:06:44.778 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-28T00:06:44.779 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-28T00:06:44.780 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-28T00:06:44.781 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-28T00:06:44.782 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-28T00:06:44.783 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-28T00:06:44.784 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-28T00:06:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-28T00:06:44.786 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-28T00:06:44.787 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-28T00:06:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-28T00:06:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-28T00:06:44.790 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-28T00:06:44.791 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-28T00:06:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-28T00:06:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-28T00:06:44.794 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-28T00:06:44.797 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-28T00:06:44.798 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-28T00:06:44.799 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-28T00:06:44.800 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-28T00:06:44.801 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-28T00:06:44.802 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-28T00:06:44.803 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-28T00:06:44.804 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-28T00:06:44.805 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-28T00:06:44.806 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-28T00:06:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-28T00:06:44.808 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-28T00:06:44.809 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-28T00:06:44.810 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-28T00:06:44.811 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-28T00:06:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-28T00:06:44.813 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-28T00:06:44.814 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-28T00:06:44.815 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-28T00:06:44.816 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-28T00:06:44.817 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-28T00:06:44.818 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-28T00:06:44.819 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-28T00:06:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-28T00:06:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-28T00:06:44.822 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-28T00:06:44.823 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-28T00:06:44.824 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-28T00:06:44.825 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-28T00:06:44.826 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-28T00:06:44.827 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-28T00:06:44.828 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-28T00:06:44.829 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-28T00:06:44.830 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-28T00:06:44.831 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-28T00:06:44.832 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-28T00:06:44.833 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-28T00:06:44.834 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-28T00:06:44.835 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-28T00:06:44.836 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-28T00:06:44.837 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-28T00:06:44.838 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-28T00:06:44.839 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-28T00:06:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-28T00:06:44.841 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-28T00:06:44.842 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-28T00:06:44.843 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-28T00:06:44.844 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-28T00:06:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-28T00:06:44.846 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-28T00:06:44.847 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-28T00:06:44.848 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-28T00:06:44.849 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-28T00:06:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-28T00:06:44.851 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-28T00:06:44.852 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-28T00:06:44.853 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-28T00:06:44.854 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-28T00:06:44.855 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-28T00:06:44.856 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-28T00:06:44.857 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-28T00:06:44.858 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-28T00:06:44.859 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-28T00:06:44.860 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-28T00:06:44.861 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-28T00:06:44.862 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-28T00:06:44.863 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-28T00:06:44.864 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-28T00:06:44.865 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-28T00:06:44.866 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-28T00:06:44.867 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-28T00:06:44.868 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-28T00:06:44.869 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-28T00:06:44.870 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-28T00:06:44.871 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-28T00:06:44.872 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-28T00:06:44.873 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-28T00:06:44.874 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-28T00:06:44.875 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-28T00:06:44.876 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-28T00:06:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-28T00:06:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-28T00:06:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-28T00:06:44.880 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-28T00:06:44.881 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-28T00:06:44.882 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-28T00:06:44.883 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-28T00:06:44.884 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-28T00:06:44.885 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-28T00:06:44.886 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-28T00:06:44.887 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-28T00:06:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-28T00:06:44.889 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-28T00:06:44.890 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-28T00:06:44.891 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-28T00:06:44.892 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-28T00:06:44.893 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-28T00:06:44.894 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-28T00:06:44.895 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-28T00:06:44.896 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-28T00:06:44.897 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-28T00:06:44.898 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-28T00:06:44.899 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-28T00:06:44.900 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-28T00:06:44.901 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-28T00:06:44.902 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-28T00:06:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-28T00:06:44.904 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-28T00:06:44.905 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-28T00:06:44.906 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-28T00:06:44.907 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-28T00:06:44.908 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-28T00:06:44.909 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-28T00:06:44.910 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-28T00:06:44.911 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-28T00:06:44.912 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-28T00:06:44.913 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-28T00:06:44.913 INFO:teuthology.orchestra.run.smithi053.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-28T00:06:44.913 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.913 DEBUG:teuthology.orchestra.run.smithi053:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-28T00:06:44.938 INFO:teuthology.orchestra.run.smithi053.stdout:postinstall scriptlet (using /bin/sh): 2023-09-28T00:06:44.938 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-28T00:06:44.938 INFO:teuthology.orchestra.run.smithi053.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.939 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2023-09-28T00:06:44.940 INFO:teuthology.orchestra.run.smithi053.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-28T00:06:44.940 INFO:teuthology.orchestra.run.smithi053.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-28T00:06:44.940 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:44.940 INFO:teuthology.orchestra.run.smithi053.stdout:fi 2023-09-28T00:06:44.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2023-09-28T00:06:45.018 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2023-09-28T00:06:45.018 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2023-09-28T00:06:45.018 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.02 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 99.el8_4.1 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:Group : System Environment/Base 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 9264631 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2023-09-28T00:06:45.019 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Relocations : (not relocatable) 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : Red Hat, Inc. 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : Red Hat, Inc. 2023-09-28T00:06:45.020 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:06:45.021 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2023-09-28T00:06:45.022 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-28T00:06:45.022 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:45.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-28T00:06:51.226 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2023-09-28T00:06:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:done 2023-09-28T00:06:53.437 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-09-28T00:06:53.467 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.UcYGWgWemk 2023-09-28T00:06:53.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UcYGWgWemk 2023-09-28T00:06:53.536 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.UcYGWgWemk 2023-09-28T00:06:53.695 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.UcYGWgWemk is 6KB 2023-09-28T00:06:53.743 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.UcYGWgWemk 2023-09-28T00:06:53.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2023-09-28T00:06:53.820 INFO:teuthology.orchestra.run.smithi053.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-09-28T00:06:53.820 INFO:teuthology.orchestra.run.smithi053.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-09-28T00:06:53.820 INFO:teuthology.orchestra.run.smithi053.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-09-28T00:06:53.820 INFO:teuthology.orchestra.run.smithi053.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-09-28T00:06:53.820 INFO:teuthology.orchestra.run.smithi053.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-09-28T00:06:53.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-09-28T00:06:54.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2023-09-28T00:07:24.021 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-28T00:07:24.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-28T00:07:24.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:08:24.024 DEBUG:teuthology.orchestra.remote:timed out 2023-09-28T00:08:33.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-28T00:08:33.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:08:33.351 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-09-28T00:08:33.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-28T00:08:33.712 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-28T00:08:33.712 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-09-28T00:08:33.747 INFO:teuthology.orchestra.run.smithi053.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-28T00:08:33.747 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-28T00:08:33.748 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-28T00:08:33.748 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-28T00:08:34.748 DEBUG:teuthology.parallel:result is None 2023-09-28T00:08:34.749 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-28T00:08:34.945 INFO:teuthology.task.internal:Creating test directory... 2023-09-28T00:08:34.945 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T00:08:34.950 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T00:08:34.986 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-28T00:08:34.998 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-28T00:08:35.043 INFO:teuthology.task.internal:Creating archive directory... 2023-09-28T00:08:35.043 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T00:08:35.047 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T00:08:35.098 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-28T00:08:35.108 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-28T00:08:35.108 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T00:08:35.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:08:35.133 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T00:08:35.138 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T00:08:35.215 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:08:35.241 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:08:35.258 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:08:35.298 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:08:35.301 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-28T00:08:35.426 INFO:teuthology.task.internal:Configuring sudo... 2023-09-28T00:08:35.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T00:08:35.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T00:08:35.492 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-28T00:08:35.515 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-28T00:08:35.515 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T00:08:35.520 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T00:08:35.553 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:08:35.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:08:35.754 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:08:35.817 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:08:35.896 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:08:35.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T00:08:35.958 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:08:36.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:08:36.045 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:08:36.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:08:36.167 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:08:36.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T00:08:36.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2023-09-28T00:08:36.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-09-28T00:08:36.329 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:08:36.340 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:08:36.820 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-28T00:08:36.924 INFO:teuthology.task.internal:Starting timer... 2023-09-28T00:08:36.925 INFO:teuthology.run_tasks:Running task pcp... 2023-09-28T00:08:36.969 INFO:teuthology.run_tasks:Running task selinux... 2023-09-28T00:08:37.016 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-28T00:08:37.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2023-09-28T00:08:37.137 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: [ OK ] 2023-09-28T00:08:37.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-09-28T00:08:37.193 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: [ OK ] 2023-09-28T00:08:37.195 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-28T00:08:37.195 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2023-09-28T00:08:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2023-09-28T00:08:37.238 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-09-28T00:08:37.272 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-09-28T00:08:37.273 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2023-09-28T00:08:37.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:08:37.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:08:37.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:08:37.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:08:37.365 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-28T00:08:37.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2023-09-28T00:08:37.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-09-28T00:08:37.451 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-28T00:08:37.481 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-28T00:08:37.488 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-28T00:08:37.602 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-28T00:08:37.618 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-28T00:08:37.619 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-28T00:19:42.668 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2023-09-28T00:19:42.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-28T00:19:42.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:19:42.758 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-09-28T00:19:42.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-28T00:19:42.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T00:19:42.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:19:42.933 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-09-28T00:19:42.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T00:19:42.997 INFO:teuthology.run_tasks:Running task clock... 2023-09-28T00:19:43.009 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-28T00:19:43.009 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T00:19:43.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:19:43.013 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T00:19:43.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:19:43.067 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T00:19:43.078 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T00:19:43.081 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T00:19:43.114 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T00:19:43.119 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-09-28T00:19:43.129 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-09-28T00:19:43.142 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T00:19:43.156 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T00:19:43.177 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2023-09-28T00:19:43.204 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2023-09-28T00:19:43.226 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-09-28T00:19:43.228 INFO:teuthology.orchestra.run.smithi118.stdout:210 Number of sources = 4 2023-09-28T00:19:43.228 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:19:43.229 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-09-28T00:19:43.229 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.229 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.229 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.229 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.238 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T00:19:43.273 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T00:19:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-09-28T00:19:43.361 INFO:teuthology.orchestra.run.smithi053.stdout:210 Number of sources = 4 2023-09-28T00:19:43.362 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:19:43.362 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-09-28T00:19:43.362 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.362 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.362 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.362 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:19:43.363 INFO:teuthology.run_tasks:Running task install... 2023-09-28T00:19:43.372 DEBUG:teuthology.task.install:project ceph 2023-09-28T00:19:43.372 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}} 2023-09-28T00:19:43.372 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'} 2023-09-28T00:19:43.372 INFO:teuthology.task.install:Using flavor: default 2023-09-28T00:19:43.378 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-28T00:19:43.378 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-28T00:19:43.379 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'tag': None, 'wait_for_package': False} 2023-09-28T00:19:43.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:19:43.382 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'tag': None, 'wait_for_package': False} 2023-09-28T00:19:43.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:19:43.519 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/ 2023-09-28T00:19:43.520 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1161.g471b6dfd 2023-09-28T00:19:43.596 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/ 2023-09-28T00:19:43.596 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1161.g471b6dfd 2023-09-28T00:19:43.684 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T00:19:43.684 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:19:43.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T00:19:43.700 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T00:19:43.701 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:19:43.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T00:19:43.726 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-28T00:19:43.726 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T00:19:43.749 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-28T00:19:43.749 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T00:19:43.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T00:19:43.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T00:19:43.864 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T00:19:43.926 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-09-28T00:19:43.927 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-09-28T00:19:43.942 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T00:19:44.004 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2023-09-28T00:19:44.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2023-09-28T00:19:44.309 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-09-28T00:19:44.503 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-28T00:19:44.624 INFO:teuthology.orchestra.run.smithi118.stdout:44 files removed 2023-09-28T00:19:44.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-28T00:19:44.840 INFO:teuthology.orchestra.run.smithi053.stdout:44 files removed 2023-09-28T00:19:44.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-28T00:19:45.016 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-09-28T00:19:45.391 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-28T00:19:45.738 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 277 kB/s | 78 kB 00:00 2023-09-28T00:19:46.083 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-09-28T00:19:46.206 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 249 kB/s | 78 kB 00:00 2023-09-28T00:19:46.358 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-09-28T00:19:46.493 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-09-28T00:19:46.554 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-09-28T00:19:46.892 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-09-28T00:19:47.009 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 41 kB/s | 3.5 kB 00:00 2023-09-28T00:19:48.470 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 16 MB 00:01 2023-09-28T00:19:48.656 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2023-09-28T00:19:51.826 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-09-28T00:19:52.172 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 124 MB/s | 33 MB 00:00 2023-09-28T00:19:52.352 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2023-09-28T00:19:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 MB/s | 38 MB 00:00 2023-09-28T00:19:57.334 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 129 MB/s | 38 MB 00:00 2023-09-28T00:19:59.190 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 77 MB/s | 33 MB 00:00 2023-09-28T00:20:05.751 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:20:05.752 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:20:05.762 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-09-28T00:20:05.763 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-09-28T00:20:05.764 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-09-28T00:20:05.765 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-28T00:20:05.766 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-28T00:20:05.769 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-09-28T00:20:05.770 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-09-28T00:20:06.249 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================================== 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================================== 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 6.4 k 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.2 M 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 874 k 2023-09-28T00:20:06.261 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 162 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 1.6 M 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 121 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 1.7 M 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 7.4 M 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 47 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 52 M 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 267 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 80 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 255 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 18 k 2023-09-28T00:20:06.262 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 25 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 796 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 130 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 190 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 371 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 359 k 2023-09-28T00:20:06.263 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 107 k 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 91 k 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 173 k 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.6 M 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 23 M 2023-09-28T00:20:06.264 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 23 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 2.3 M 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 238 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.9 M 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 14 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 24 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-28T00:20:06.265 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 175 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 507 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.6 M 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T00:20:06.266 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T00:20:06.267 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 45 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 115 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T00:20:06.268 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-28T00:20:06.269 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-28T00:20:06.269 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-28T00:20:06.269 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:20:06.269 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T00:20:06.269 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T00:20:06.269 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-28T00:20:06.270 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-28T00:20:06.270 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T00:20:06.270 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T00:20:06.270 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-28T00:20:06.270 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T00:20:06.271 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T00:20:06.272 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================================== 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout:Install 118 Packages 2023-09-28T00:20:06.273 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 2 Packages 2023-09-28T00:20:06.274 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:20:06.274 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 201 M 2023-09-28T00:20:06.274 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-09-28T00:20:06.678 INFO:teuthology.orchestra.run.smithi118.stdout:(1/120): ceph-17.2.6-1161.g471b6dfd.el8.x86_64. 68 kB/s | 6.4 kB 00:00 2023-09-28T00:20:06.879 INFO:teuthology.orchestra.run.smithi118.stdout:(2/120): ceph-fuse-17.2.6-1161.g471b6dfd.el8.x8 4.2 MB/s | 874 kB 00:00 2023-09-28T00:20:06.941 INFO:teuthology.orchestra.run.smithi118.stdout:(3/120): ceph-immutable-object-cache-17.2.6-116 2.6 MB/s | 162 kB 00:00 2023-09-28T00:20:07.285 INFO:teuthology.orchestra.run.smithi118.stdout:(4/120): ceph-mds-17.2.6-1161.g471b6dfd.el8.x86 6.7 MB/s | 2.3 MB 00:00 2023-09-28T00:20:07.531 INFO:teuthology.orchestra.run.smithi118.stdout:(5/120): ceph-mgr-17.2.6-1161.g471b6dfd.el8.x86 6.4 MB/s | 1.6 MB 00:00 2023-09-28T00:20:08.084 INFO:teuthology.orchestra.run.smithi118.stdout:(6/120): ceph-common-17.2.6-1161.g471b6dfd.el8. 16 MB/s | 23 MB 00:01 2023-09-28T00:20:08.132 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:20:08.132 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:20:08.144 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-09-28T00:20:08.145 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-09-28T00:20:08.146 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-09-28T00:20:08.147 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-28T00:20:08.149 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-28T00:20:08.152 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-09-28T00:20:08.152 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-09-28T00:20:08.171 INFO:teuthology.orchestra.run.smithi118.stdout:(7/120): ceph-mon-17.2.6-1161.g471b6dfd.el8.x86 6.1 MB/s | 3.9 MB 00:00 2023-09-28T00:20:08.210 INFO:teuthology.orchestra.run.smithi118.stdout:(8/120): ceph-base-17.2.6-1161.g471b6dfd.el8.x8 3.2 MB/s | 5.2 MB 00:01 2023-09-28T00:20:08.285 INFO:teuthology.orchestra.run.smithi118.stdout:(9/120): ceph-selinux-17.2.6-1161.g471b6dfd.el8 322 kB/s | 24 kB 00:00 2023-09-28T00:20:08.712 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-09-28T00:20:08.724 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================================================== 2023-09-28T00:20:08.724 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2023-09-28T00:20:08.724 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================================================== 2023-09-28T00:20:08.724 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 6.4 k 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.2 M 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 874 k 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 162 k 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 1.6 M 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 121 k 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 1.7 M 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 7.4 M 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 47 k 2023-09-28T00:20:08.725 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 52 M 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 267 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 80 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 255 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 18 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 25 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 796 k 2023-09-28T00:20:08.726 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 130 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 190 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 371 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 359 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 107 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 91 k 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:20:08.727 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 173 k 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.6 M 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 23 M 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 23 k 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 2.3 M 2023-09-28T00:20:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 238 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.9 M 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 14 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 24 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 175 k 2023-09-28T00:20:08.729 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 507 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.6 M 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T00:20:08.730 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-28T00:20:08.731 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 45 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 115 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-28T00:20:08.732 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-28T00:20:08.733 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-09-28T00:20:08.734 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T00:20:08.735 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2023-09-28T00:20:08.736 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================================================== 2023-09-28T00:20:08.737 INFO:teuthology.orchestra.run.smithi053.stdout:Install 118 Packages 2023-09-28T00:20:08.737 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2023-09-28T00:20:08.737 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:20:08.737 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 201 M 2023-09-28T00:20:08.737 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2023-09-28T00:20:09.072 INFO:teuthology.orchestra.run.smithi053.stdout:(1/120): ceph-17.2.6-1161.g471b6dfd.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-09-28T00:20:09.175 INFO:teuthology.orchestra.run.smithi118.stdout:(10/120): ceph-osd-17.2.6-1161.g471b6dfd.el8.x8 15 MB/s | 17 MB 00:01 2023-09-28T00:20:09.497 INFO:teuthology.orchestra.run.smithi053.stdout:(2/120): ceph-base-17.2.6-1161.g471b6dfd.el8.x8 7.4 MB/s | 5.2 MB 00:00 2023-09-28T00:20:09.538 INFO:teuthology.orchestra.run.smithi053.stdout:(3/120): ceph-immutable-object-cache-17.2.6-116 3.9 MB/s | 162 kB 00:00 2023-09-28T00:20:09.732 INFO:teuthology.orchestra.run.smithi053.stdout:(4/120): ceph-mds-17.2.6-1161.g471b6dfd.el8.x86 12 MB/s | 2.3 MB 00:00 2023-09-28T00:20:09.859 INFO:teuthology.orchestra.run.smithi118.stdout:(11/120): cephfs-mirror-17.2.6-1161.g471b6dfd.e 373 kB/s | 255 kB 00:00 2023-09-28T00:20:09.864 INFO:teuthology.orchestra.run.smithi053.stdout:(5/120): ceph-mgr-17.2.6-1161.g471b6dfd.el8.x86 12 MB/s | 1.6 MB 00:00 2023-09-28T00:20:09.898 INFO:teuthology.orchestra.run.smithi118.stdout:(12/120): libcephfs-devel-17.2.6-1161.g471b6dfd 649 kB/s | 25 kB 00:00 2023-09-28T00:20:10.155 INFO:teuthology.orchestra.run.smithi118.stdout:(13/120): libcephfs2-17.2.6-1161.g471b6dfd.el8. 3.0 MB/s | 796 kB 00:00 2023-09-28T00:20:10.212 INFO:teuthology.orchestra.run.smithi118.stdout:(14/120): libcephsqlite-17.2.6-1161.g471b6dfd.e 3.0 MB/s | 175 kB 00:00 2023-09-28T00:20:10.228 INFO:teuthology.orchestra.run.smithi053.stdout:(6/120): ceph-mon-17.2.6-1161.g471b6dfd.el8.x86 11 MB/s | 3.9 MB 00:00 2023-09-28T00:20:10.242 INFO:teuthology.orchestra.run.smithi118.stdout:(15/120): librados-devel-17.2.6-1161.g471b6dfd. 4.2 MB/s | 130 kB 00:00 2023-09-28T00:20:10.254 INFO:teuthology.orchestra.run.smithi053.stdout:(7/120): ceph-fuse-17.2.6-1161.g471b6dfd.el8.x8 739 kB/s | 874 kB 00:01 2023-09-28T00:20:10.357 INFO:teuthology.orchestra.run.smithi118.stdout:(16/120): libradosstriper1-17.2.6-1161.g471b6df 4.3 MB/s | 507 kB 00:00 2023-09-28T00:20:11.193 INFO:teuthology.orchestra.run.smithi118.stdout:(17/120): librgw2-17.2.6-1161.g471b6dfd.el8.x86 6.7 MB/s | 5.6 MB 00:00 2023-09-28T00:20:11.249 INFO:teuthology.orchestra.run.smithi118.stdout:(18/120): python3-ceph-argparse-17.2.6-1161.g47 794 kB/s | 45 kB 00:00 2023-09-28T00:20:11.309 INFO:teuthology.orchestra.run.smithi118.stdout:(19/120): python3-ceph-common-17.2.6-1161.g471b 1.9 MB/s | 115 kB 00:00 2023-09-28T00:20:11.371 INFO:teuthology.orchestra.run.smithi118.stdout:(20/120): python3-cephfs-17.2.6-1161.g471b6dfd. 3.0 MB/s | 190 kB 00:00 2023-09-28T00:20:11.440 INFO:teuthology.orchestra.run.smithi118.stdout:(21/120): python3-rados-17.2.6-1161.g471b6dfd.e 5.2 MB/s | 371 kB 00:00 2023-09-28T00:20:11.510 INFO:teuthology.orchestra.run.smithi118.stdout:(22/120): python3-rbd-17.2.6-1161.g471b6dfd.el8 5.0 MB/s | 359 kB 00:00 2023-09-28T00:20:11.571 INFO:teuthology.orchestra.run.smithi118.stdout:(23/120): python3-rgw-17.2.6-1161.g471b6dfd.el8 1.7 MB/s | 107 kB 00:00 2023-09-28T00:20:11.626 INFO:teuthology.orchestra.run.smithi118.stdout:(24/120): rbd-fuse-17.2.6-1161.g471b6dfd.el8.x8 1.6 MB/s | 91 kB 00:00 2023-09-28T00:20:11.773 INFO:teuthology.orchestra.run.smithi053.stdout:(8/120): ceph-osd-17.2.6-1161.g471b6dfd.el8.x86 11 MB/s | 17 MB 00:01 2023-09-28T00:20:11.794 INFO:teuthology.orchestra.run.smithi053.stdout:(9/120): ceph-selinux-17.2.6-1161.g471b6dfd.el8 1.1 MB/s | 24 kB 00:00 2023-09-28T00:20:11.851 INFO:teuthology.orchestra.run.smithi118.stdout:(25/120): ceph-radosgw-17.2.6-1161.g471b6dfd.el 4.6 MB/s | 17 MB 00:03 2023-09-28T00:20:11.925 INFO:teuthology.orchestra.run.smithi118.stdout:(26/120): rbd-nbd-17.2.6-1161.g471b6dfd.el8.x86 2.3 MB/s | 173 kB 00:00 2023-09-28T00:20:11.994 INFO:teuthology.orchestra.run.smithi118.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1161.g 336 kB/s | 23 kB 00:00 2023-09-28T00:20:12.067 INFO:teuthology.orchestra.run.smithi118.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1161.g471b6df 1.6 MB/s | 121 kB 00:00 2023-09-28T00:20:12.181 INFO:teuthology.orchestra.run.smithi118.stdout:(29/120): rbd-mirror-17.2.6-1161.g471b6dfd.el8. 6.2 MB/s | 3.5 MB 00:00 2023-09-28T00:20:12.650 INFO:teuthology.orchestra.run.smithi118.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1161.g471b6 2.9 MB/s | 1.7 MB 00:00 2023-09-28T00:20:12.794 INFO:teuthology.orchestra.run.smithi118.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1161.g47 1.6 MB/s | 238 kB 00:00 2023-09-28T00:20:12.851 INFO:teuthology.orchestra.run.smithi118.stdout:(32/120): ceph-mgr-rook-17.2.6-1161.g471b6dfd.e 827 kB/s | 47 kB 00:00 2023-09-28T00:20:12.906 INFO:teuthology.orchestra.run.smithi118.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1161.g4 264 kB/s | 14 kB 00:00 2023-09-28T00:20:12.927 INFO:teuthology.orchestra.run.smithi053.stdout:(10/120): ceph-common-17.2.6-1161.g471b6dfd.el8 5.7 MB/s | 23 MB 00:04 2023-09-28T00:20:13.002 INFO:teuthology.orchestra.run.smithi053.stdout:(11/120): cephfs-mirror-17.2.6-1161.g471b6dfd.e 3.3 MB/s | 255 kB 00:00 2023-09-28T00:20:13.031 INFO:teuthology.orchestra.run.smithi118.stdout:(34/120): ceph-volume-17.2.6-1161.g471b6dfd.el8 2.1 MB/s | 267 kB 00:00 2023-09-28T00:20:13.061 INFO:teuthology.orchestra.run.smithi053.stdout:(12/120): libcephfs-devel-17.2.6-1161.g471b6dfd 424 kB/s | 25 kB 00:00 2023-09-28T00:20:13.089 INFO:teuthology.orchestra.run.smithi118.stdout:(35/120): cephadm-17.2.6-1161.g471b6dfd.el8.noa 1.4 MB/s | 80 kB 00:00 2023-09-28T00:20:13.161 INFO:teuthology.orchestra.run.smithi118.stdout:(36/120): cephfs-top-17.2.6-1161.g471b6dfd.el8. 252 kB/s | 18 kB 00:00 2023-09-28T00:20:13.204 INFO:teuthology.orchestra.run.smithi053.stdout:(13/120): libcephfs2-17.2.6-1161.g471b6dfd.el8. 5.5 MB/s | 796 kB 00:00 2023-09-28T00:20:13.235 INFO:teuthology.orchestra.run.smithi118.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 7.0 MB/s | 7.4 MB 00:01 2023-09-28T00:20:13.256 INFO:teuthology.orchestra.run.smithi053.stdout:(14/120): libcephsqlite-17.2.6-1161.g471b6dfd.e 3.3 MB/s | 175 kB 00:00 2023-09-28T00:20:13.298 INFO:teuthology.orchestra.run.smithi053.stdout:(15/120): librados-devel-17.2.6-1161.g471b6dfd. 3.1 MB/s | 130 kB 00:00 2023-09-28T00:20:13.389 INFO:teuthology.orchestra.run.smithi053.stdout:(16/120): libradosstriper1-17.2.6-1161.g471b6df 5.4 MB/s | 507 kB 00:00 2023-09-28T00:20:14.122 INFO:teuthology.orchestra.run.smithi053.stdout:(17/120): librgw2-17.2.6-1161.g471b6dfd.el8.x86 7.6 MB/s | 5.6 MB 00:00 2023-09-28T00:20:14.164 INFO:teuthology.orchestra.run.smithi053.stdout:(18/120): python3-ceph-argparse-17.2.6-1161.g47 1.0 MB/s | 45 kB 00:00 2023-09-28T00:20:14.208 INFO:teuthology.orchestra.run.smithi053.stdout:(19/120): python3-ceph-common-17.2.6-1161.g471b 2.6 MB/s | 115 kB 00:00 2023-09-28T00:20:14.253 INFO:teuthology.orchestra.run.smithi053.stdout:(20/120): python3-cephfs-17.2.6-1161.g471b6dfd. 4.1 MB/s | 190 kB 00:00 2023-09-28T00:20:14.280 INFO:teuthology.orchestra.run.smithi118.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 56 kB/s | 59 kB 00:01 2023-09-28T00:20:14.305 INFO:teuthology.orchestra.run.smithi053.stdout:(21/120): python3-rados-17.2.6-1161.g471b6dfd.e 7.0 MB/s | 371 kB 00:00 2023-09-28T00:20:14.359 INFO:teuthology.orchestra.run.smithi053.stdout:(22/120): python3-rbd-17.2.6-1161.g471b6dfd.el8 6.6 MB/s | 359 kB 00:00 2023-09-28T00:20:14.403 INFO:teuthology.orchestra.run.smithi053.stdout:(23/120): python3-rgw-17.2.6-1161.g471b6dfd.el8 2.4 MB/s | 107 kB 00:00 2023-09-28T00:20:14.441 INFO:teuthology.orchestra.run.smithi053.stdout:(24/120): rbd-fuse-17.2.6-1161.g471b6dfd.el8.x8 2.3 MB/s | 91 kB 00:00 2023-09-28T00:20:14.624 INFO:teuthology.orchestra.run.smithi118.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 218 kB/s | 75 kB 00:00 2023-09-28T00:20:14.684 INFO:teuthology.orchestra.run.smithi118.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 201 kB/s | 306 kB 00:01 2023-09-28T00:20:14.907 INFO:teuthology.orchestra.run.smithi118.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 196 kB/s | 44 kB 00:00 2023-09-28T00:20:14.915 INFO:teuthology.orchestra.run.smithi053.stdout:(25/120): rbd-mirror-17.2.6-1161.g471b6dfd.el8. 7.3 MB/s | 3.5 MB 00:00 2023-09-28T00:20:14.961 INFO:teuthology.orchestra.run.smithi053.stdout:(26/120): rbd-nbd-17.2.6-1161.g471b6dfd.el8.x86 3.7 MB/s | 173 kB 00:00 2023-09-28T00:20:15.002 INFO:teuthology.orchestra.run.smithi053.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1161.g 566 kB/s | 23 kB 00:00 2023-09-28T00:20:15.042 INFO:teuthology.orchestra.run.smithi053.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1161.g471b6df 3.0 MB/s | 121 kB 00:00 2023-09-28T00:20:15.197 INFO:teuthology.orchestra.run.smithi118.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 639 kB/s | 185 kB 00:00 2023-09-28T00:20:15.355 INFO:teuthology.orchestra.run.smithi118.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 651 kB/s | 476 kB 00:00 2023-09-28T00:20:15.415 INFO:teuthology.orchestra.run.smithi118.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 151 kB/s | 33 kB 00:00 2023-09-28T00:20:15.436 INFO:teuthology.orchestra.run.smithi053.stdout:(29/120): ceph-test-17.2.6-1161.g471b6dfd.el8.x 14 MB/s | 52 MB 00:03 2023-09-28T00:20:15.443 INFO:teuthology.orchestra.run.smithi053.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1161.g471b6 4.2 MB/s | 1.7 MB 00:00 2023-09-28T00:20:15.490 INFO:teuthology.orchestra.run.smithi053.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1161.g47 5.0 MB/s | 238 kB 00:00 2023-09-28T00:20:15.531 INFO:teuthology.orchestra.run.smithi053.stdout:(32/120): ceph-mgr-rook-17.2.6-1161.g471b6dfd.e 1.1 MB/s | 47 kB 00:00 2023-09-28T00:20:15.567 INFO:teuthology.orchestra.run.smithi118.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 77 kB/s | 16 kB 00:00 2023-09-28T00:20:15.569 INFO:teuthology.orchestra.run.smithi053.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1161.g4 381 kB/s | 14 kB 00:00 2023-09-28T00:20:15.618 INFO:teuthology.orchestra.run.smithi053.stdout:(34/120): ceph-volume-17.2.6-1161.g471b6dfd.el8 5.4 MB/s | 267 kB 00:00 2023-09-28T00:20:15.661 INFO:teuthology.orchestra.run.smithi053.stdout:(35/120): cephadm-17.2.6-1161.g471b6dfd.el8.noa 1.8 MB/s | 80 kB 00:00 2023-09-28T00:20:15.698 INFO:teuthology.orchestra.run.smithi118.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 610 kB/s | 173 kB 00:00 2023-09-28T00:20:15.699 INFO:teuthology.orchestra.run.smithi053.stdout:(36/120): cephfs-top-17.2.6-1161.g471b6dfd.el8. 483 kB/s | 18 kB 00:00 2023-09-28T00:20:15.831 INFO:teuthology.orchestra.run.smithi053.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 19 MB/s | 7.4 MB 00:00 2023-09-28T00:20:15.877 INFO:teuthology.orchestra.run.smithi118.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2023-09-28T00:20:15.939 INFO:teuthology.orchestra.run.smithi118.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 338 kB/s | 81 kB 00:00 2023-09-28T00:20:16.086 INFO:teuthology.orchestra.run.smithi118.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 53 kB/s | 11 kB 00:00 2023-09-28T00:20:16.150 INFO:teuthology.orchestra.run.smithi118.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 83 kB/s | 18 kB 00:00 2023-09-28T00:20:16.376 INFO:teuthology.orchestra.run.smithi118.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 216 kB/s | 49 kB 00:00 2023-09-28T00:20:16.563 INFO:teuthology.orchestra.run.smithi053.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 354 kB/s | 306 kB 00:00 2023-09-28T00:20:16.606 INFO:teuthology.orchestra.run.smithi118.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 255 kB/s | 59 kB 00:00 2023-09-28T00:20:16.614 INFO:teuthology.orchestra.run.smithi118.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 2.2 MB/s | 1.2 MB 00:00 2023-09-28T00:20:16.700 INFO:teuthology.orchestra.run.smithi053.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 551 kB/s | 75 kB 00:00 2023-09-28T00:20:16.838 INFO:teuthology.orchestra.run.smithi118.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 259 kB/s | 60 kB 00:00 2023-09-28T00:20:16.847 INFO:teuthology.orchestra.run.smithi118.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-09-28T00:20:16.923 INFO:teuthology.orchestra.run.smithi053.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 54 kB/s | 59 kB 00:01 2023-09-28T00:20:16.946 INFO:teuthology.orchestra.run.smithi053.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-09-28T00:20:17.049 INFO:teuthology.orchestra.run.smithi118.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 74 kB/s | 16 kB 00:00 2023-09-28T00:20:17.056 INFO:teuthology.orchestra.run.smithi118.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 161 kB/s | 34 kB 00:00 2023-09-28T00:20:17.062 INFO:teuthology.orchestra.run.smithi053.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-09-28T00:20:17.117 INFO:teuthology.orchestra.run.smithi053.stdout:(43/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 224 kB/s | 44 kB 00:00 2023-09-28T00:20:17.173 INFO:teuthology.orchestra.run.smithi053.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 298 kB/s | 33 kB 00:00 2023-09-28T00:20:17.265 INFO:teuthology.orchestra.run.smithi053.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 110 kB/s | 16 kB 00:00 2023-09-28T00:20:17.268 INFO:teuthology.orchestra.run.smithi118.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 303 kB/s | 64 kB 00:00 2023-09-28T00:20:17.307 INFO:teuthology.orchestra.run.smithi053.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-09-28T00:20:17.344 INFO:teuthology.orchestra.run.smithi118.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 666 kB/s | 196 kB 00:00 2023-09-28T00:20:17.426 INFO:teuthology.orchestra.run.smithi053.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 686 kB/s | 81 kB 00:00 2023-09-28T00:20:17.476 INFO:teuthology.orchestra.run.smithi118.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 90 kB/s | 19 kB 00:00 2023-09-28T00:20:17.542 INFO:teuthology.orchestra.run.smithi053.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 96 kB/s | 11 kB 00:00 2023-09-28T00:20:17.557 INFO:teuthology.orchestra.run.smithi118.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 112 kB/s | 24 kB 00:00 2023-09-28T00:20:17.657 INFO:teuthology.orchestra.run.smithi053.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 154 kB/s | 18 kB 00:00 2023-09-28T00:20:17.685 INFO:teuthology.orchestra.run.smithi118.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 140 kB/s | 29 kB 00:00 2023-09-28T00:20:17.760 INFO:teuthology.orchestra.run.smithi053.stdout:(50/120): python3-cherrypy-18.4.0-1.el8.noarch. 778 kB/s | 384 kB 00:00 2023-09-28T00:20:17.774 INFO:teuthology.orchestra.run.smithi118.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 127 kB/s | 27 kB 00:00 2023-09-28T00:20:17.892 INFO:teuthology.orchestra.run.smithi053.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 368 kB/s | 49 kB 00:00 2023-09-28T00:20:17.903 INFO:teuthology.orchestra.run.smithi053.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 4.7 MB/s | 1.2 MB 00:00 2023-09-28T00:20:17.915 INFO:teuthology.orchestra.run.smithi118.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2023-09-28T00:20:18.017 INFO:teuthology.orchestra.run.smithi053.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 532 kB/s | 60 kB 00:00 2023-09-28T00:20:18.027 INFO:teuthology.orchestra.run.smithi053.stdout:(54/120): python3-more-itertools-7.2.0-3.el8.no 439 kB/s | 59 kB 00:00 2023-09-28T00:20:18.095 INFO:teuthology.orchestra.run.smithi118.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 783 kB/s | 251 kB 00:00 2023-09-28T00:20:18.127 INFO:teuthology.orchestra.run.smithi118.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 289 kB/s | 61 kB 00:00 2023-09-28T00:20:18.142 INFO:teuthology.orchestra.run.smithi053.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-09-28T00:20:18.153 INFO:teuthology.orchestra.run.smithi053.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 123 kB/s | 16 kB 00:00 2023-09-28T00:20:18.257 INFO:teuthology.orchestra.run.smithi053.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 293 kB/s | 34 kB 00:00 2023-09-28T00:20:18.335 INFO:teuthology.orchestra.run.smithi118.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 110 kB/s | 23 kB 00:00 2023-09-28T00:20:18.335 INFO:teuthology.orchestra.run.smithi118.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 355 kB/s | 85 kB 00:00 2023-09-28T00:20:18.369 INFO:teuthology.orchestra.run.smithi053.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 574 kB/s | 64 kB 00:00 2023-09-28T00:20:18.479 INFO:teuthology.orchestra.run.smithi053.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 171 kB/s | 19 kB 00:00 2023-09-28T00:20:18.594 INFO:teuthology.orchestra.run.smithi053.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 209 kB/s | 24 kB 00:00 2023-09-28T00:20:18.653 INFO:teuthology.orchestra.run.smithi053.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 393 kB/s | 196 kB 00:00 2023-09-28T00:20:18.722 INFO:teuthology.orchestra.run.smithi053.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 228 kB/s | 29 kB 00:00 2023-09-28T00:20:18.730 INFO:teuthology.orchestra.run.smithi118.stdout:(69/120): ceph-test-17.2.6-1161.g471b6dfd.el8.x 4.9 MB/s | 52 MB 00:10 2023-09-28T00:20:18.731 INFO:teuthology.orchestra.run.smithi118.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 176 kB/s | 70 kB 00:00 2023-09-28T00:20:18.775 INFO:teuthology.orchestra.run.smithi118.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-09-28T00:20:18.790 INFO:teuthology.orchestra.run.smithi118.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-09-28T00:20:18.807 INFO:teuthology.orchestra.run.smithi118.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.3 MB/s | 161 kB 00:00 2023-09-28T00:20:18.826 INFO:teuthology.orchestra.run.smithi118.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-09-28T00:20:18.846 INFO:teuthology.orchestra.run.smithi118.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 22 MB/s | 457 kB 00:00 2023-09-28T00:20:18.858 INFO:teuthology.orchestra.run.smithi053.stdout:(63/120): ceph-radosgw-17.2.6-1161.g471b6dfd.el 1.9 MB/s | 17 MB 00:08 2023-09-28T00:20:18.861 INFO:teuthology.orchestra.run.smithi053.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 1.8 MB/s | 255 kB 00:00 2023-09-28T00:20:18.975 INFO:teuthology.orchestra.run.smithi053.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 541 kB/s | 61 kB 00:00 2023-09-28T00:20:19.028 INFO:teuthology.orchestra.run.smithi118.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 49 MB/s | 15 MB 00:00 2023-09-28T00:20:19.044 INFO:teuthology.orchestra.run.smithi118.stdout:(77/120): python3-babel-2.5.1-5.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-09-28T00:20:19.045 INFO:teuthology.orchestra.run.smithi118.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2023-09-28T00:20:19.061 INFO:teuthology.orchestra.run.smithi118.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-09-28T00:20:19.066 INFO:teuthology.orchestra.run.smithi118.stdout:(80/120): bison-3.0.4-10.el8.x86_64.rpm 31 MB/s | 688 kB 00:00 2023-09-28T00:20:19.077 INFO:teuthology.orchestra.run.smithi118.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 15 MB/s | 225 kB 00:00 2023-09-28T00:20:19.081 INFO:teuthology.orchestra.run.smithi118.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.4 MB/s | 126 kB 00:00 2023-09-28T00:20:19.092 INFO:teuthology.orchestra.run.smithi053.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 730 kB/s | 85 kB 00:00 2023-09-28T00:20:19.098 INFO:teuthology.orchestra.run.smithi118.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-09-28T00:20:19.117 INFO:teuthology.orchestra.run.smithi118.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 27 MB/s | 538 kB 00:00 2023-09-28T00:20:19.133 INFO:teuthology.orchestra.run.smithi118.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 67 MB/s | 3.7 MB 00:00 2023-09-28T00:20:19.136 INFO:teuthology.orchestra.run.smithi118.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 16 MB/s | 302 kB 00:00 2023-09-28T00:20:19.146 INFO:teuthology.orchestra.run.smithi118.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-09-28T00:20:19.149 INFO:teuthology.orchestra.run.smithi118.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 8.4 MB/s | 110 kB 00:00 2023-09-28T00:20:19.163 INFO:teuthology.orchestra.run.smithi118.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.4 MB/s | 20 kB 00:00 2023-09-28T00:20:19.165 INFO:teuthology.orchestra.run.smithi118.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 19 MB/s | 353 kB 00:00 2023-09-28T00:20:19.179 INFO:teuthology.orchestra.run.smithi118.stdout:(91/120): thrift-0.13.0-2.el8.x86_64.rpm 2.1 MB/s | 1.7 MB 00:00 2023-09-28T00:20:19.180 INFO:teuthology.orchestra.run.smithi118.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.5 MB/s | 54 kB 00:00 2023-09-28T00:20:19.187 INFO:teuthology.orchestra.run.smithi118.stdout:(93/120): libtool-2.4.6-25.el8.x86_64.rpm 29 MB/s | 709 kB 00:00 2023-09-28T00:20:19.207 INFO:teuthology.orchestra.run.smithi053.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 200 kB/s | 23 kB 00:00 2023-09-28T00:20:19.207 INFO:teuthology.orchestra.run.smithi118.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 34 MB/s | 713 kB 00:00 2023-09-28T00:20:19.231 INFO:teuthology.orchestra.run.smithi118.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 790 kB/s | 19 kB 00:00 2023-09-28T00:20:19.257 INFO:teuthology.orchestra.run.smithi118.stdout:(96/120): openblas-0.3.12-1.el8.x86_64.rpm 60 MB/s | 4.6 MB 00:00 2023-09-28T00:20:19.258 INFO:teuthology.orchestra.run.smithi118.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2023-09-28T00:20:19.280 INFO:teuthology.orchestra.run.smithi118.stdout:(98/120): openblas-threads-0.3.12-1.el8.x86_64. 47 MB/s | 4.7 MB 00:00 2023-09-28T00:20:19.285 INFO:teuthology.orchestra.run.smithi118.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.8 MB/s | 155 kB 00:00 2023-09-28T00:20:19.286 INFO:teuthology.orchestra.run.smithi118.stdout:(100/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.7 MB/s | 220 kB 00:00 2023-09-28T00:20:19.309 INFO:teuthology.orchestra.run.smithi118.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.9 MB/s | 229 kB 00:00 2023-09-28T00:20:19.310 INFO:teuthology.orchestra.run.smithi118.stdout:(102/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.6 MB/s | 48 kB 00:00 2023-09-28T00:20:19.316 INFO:teuthology.orchestra.run.smithi118.stdout:(103/120): python3-requests-oauthlib-1.0.0-1.el 1.4 MB/s | 43 kB 00:00 2023-09-28T00:20:19.334 INFO:teuthology.orchestra.run.smithi118.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 748 kB/s | 18 kB 00:00 2023-09-28T00:20:19.353 INFO:teuthology.orchestra.run.smithi118.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 16 MB/s | 605 kB 00:00 2023-09-28T00:20:19.369 INFO:teuthology.orchestra.run.smithi118.stdout:(106/120): openssl-devel-1.1.1g-15.el8_3.x86_64 39 MB/s | 2.3 MB 00:00 2023-09-28T00:20:19.390 INFO:teuthology.orchestra.run.smithi053.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 9.5 MB/s | 1.7 MB 00:00 2023-09-28T00:20:19.395 INFO:teuthology.orchestra.run.smithi053.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-09-28T00:20:19.425 INFO:teuthology.orchestra.run.smithi053.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 635 kB/s | 19 kB 00:00 2023-09-28T00:20:19.438 INFO:teuthology.orchestra.run.smithi053.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.3 MB/s | 43 kB 00:00 2023-09-28T00:20:19.448 INFO:teuthology.orchestra.run.smithi118.stdout:(107/120): fuse-2.9.7-12.el8.x86_64.rpm 727 kB/s | 83 kB 00:00 2023-09-28T00:20:19.453 INFO:teuthology.orchestra.run.smithi053.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.9 MB/s | 155 kB 00:00 2023-09-28T00:20:19.470 INFO:teuthology.orchestra.run.smithi053.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-09-28T00:20:19.483 INFO:teuthology.orchestra.run.smithi053.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.6 MB/s | 48 kB 00:00 2023-09-28T00:20:19.499 INFO:teuthology.orchestra.run.smithi053.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-09-28T00:20:19.512 INFO:teuthology.orchestra.run.smithi053.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.4 MB/s | 43 kB 00:00 2023-09-28T00:20:19.531 INFO:teuthology.orchestra.run.smithi118.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 330 kB/s | 59 kB 00:00 2023-09-28T00:20:19.532 INFO:teuthology.orchestra.run.smithi118.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 457 kB/s | 38 kB 00:00 2023-09-28T00:20:19.533 INFO:teuthology.orchestra.run.smithi118.stdout:(110/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.0 MB/s | 169 kB 00:00 2023-09-28T00:20:19.558 INFO:teuthology.orchestra.run.smithi118.stdout:(111/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2023-09-28T00:20:19.562 INFO:teuthology.orchestra.run.smithi118.stdout:(112/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.9 MB/s | 58 kB 00:00 2023-09-28T00:20:19.564 INFO:teuthology.orchestra.run.smithi118.stdout:(113/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.6 MB/s | 86 kB 00:00 2023-09-28T00:20:19.568 INFO:teuthology.orchestra.run.smithi053.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 41 MB/s | 2.3 MB 00:00 2023-09-28T00:20:19.583 INFO:teuthology.orchestra.run.smithi053.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-09-28T00:20:19.589 INFO:teuthology.orchestra.run.smithi118.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 18 MB/s | 559 kB 00:00 2023-09-28T00:20:19.591 INFO:teuthology.orchestra.run.smithi118.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 2.5 MB/s | 70 kB 00:00 2023-09-28T00:20:19.596 INFO:teuthology.orchestra.run.smithi118.stdout:(116/120): libgfortran-8.4.1-1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2023-09-28T00:20:19.609 INFO:teuthology.orchestra.run.smithi053.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2023-09-28T00:20:19.616 INFO:teuthology.orchestra.run.smithi118.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 7.2 MB/s | 200 kB 00:00 2023-09-28T00:20:19.618 INFO:teuthology.orchestra.run.smithi118.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 3.5 MB/s | 97 kB 00:00 2023-09-28T00:20:19.624 INFO:teuthology.orchestra.run.smithi053.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 5.4 MB/s | 83 kB 00:00 2023-09-28T00:20:19.637 INFO:teuthology.orchestra.run.smithi053.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 4.5 MB/s | 59 kB 00:00 2023-09-28T00:20:19.651 INFO:teuthology.orchestra.run.smithi053.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-09-28T00:20:19.664 INFO:teuthology.orchestra.run.smithi053.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.1 MB/s | 38 kB 00:00 2023-09-28T00:20:19.677 INFO:teuthology.orchestra.run.smithi053.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.6 MB/s | 86 kB 00:00 2023-09-28T00:20:19.689 INFO:teuthology.orchestra.run.smithi053.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.7 MB/s | 58 kB 00:00 2023-09-28T00:20:19.702 INFO:teuthology.orchestra.run.smithi053.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.6 MB/s | 47 kB 00:00 2023-09-28T00:20:19.724 INFO:teuthology.orchestra.run.smithi053.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 26 MB/s | 559 kB 00:00 2023-09-28T00:20:19.747 INFO:teuthology.orchestra.run.smithi053.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 27 MB/s | 639 kB 00:00 2023-09-28T00:20:19.761 INFO:teuthology.orchestra.run.smithi053.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.0 MB/s | 70 kB 00:00 2023-09-28T00:20:19.776 INFO:teuthology.orchestra.run.smithi053.stdout:(90/120): python3-trustme-0.6.0-4.el8.noarch.rp 24 kB/s | 27 kB 00:01 2023-09-28T00:20:19.779 INFO:teuthology.orchestra.run.smithi053.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 11 MB/s | 200 kB 00:00 2023-09-28T00:20:19.808 INFO:teuthology.orchestra.run.smithi053.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 3.0 MB/s | 97 kB 00:00 2023-09-28T00:20:19.821 INFO:teuthology.orchestra.run.smithi053.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.4 MB/s | 44 kB 00:00 2023-09-28T00:20:19.834 INFO:teuthology.orchestra.run.smithi053.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.1 MB/s | 27 kB 00:00 2023-09-28T00:20:19.850 INFO:teuthology.orchestra.run.smithi053.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-09-28T00:20:19.869 INFO:teuthology.orchestra.run.smithi053.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-09-28T00:20:19.892 INFO:teuthology.orchestra.run.smithi053.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-09-28T00:20:20.000 INFO:teuthology.orchestra.run.smithi118.stdout:(119/120): librados2-17.2.6-1161.g471b6dfd.el8. 8.6 MB/s | 3.5 MB 00:00 2023-09-28T00:20:20.018 INFO:teuthology.orchestra.run.smithi053.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-09-28T00:20:20.032 INFO:teuthology.orchestra.run.smithi053.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.8 MB/s | 39 kB 00:00 2023-09-28T00:20:20.060 INFO:teuthology.orchestra.run.smithi053.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-09-28T00:20:20.119 INFO:teuthology.orchestra.run.smithi053.stdout:(101/120): python3-scipy-1.0.0-20.module+el8.1. 43 MB/s | 15 MB 00:00 2023-09-28T00:20:20.124 INFO:teuthology.orchestra.run.smithi053.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.0 MB/s | 259 kB 00:00 2023-09-28T00:20:20.131 INFO:teuthology.orchestra.run.smithi053.stdout:(103/120): python3-webob-1.8.5-1.el8.1.noarch.r 197 kB/s | 251 kB 00:01 2023-09-28T00:20:20.136 INFO:teuthology.orchestra.run.smithi053.stdout:(104/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 13 MB/s | 225 kB 00:00 2023-09-28T00:20:20.139 INFO:teuthology.orchestra.run.smithi053.stdout:(105/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.4 MB/s | 126 kB 00:00 2023-09-28T00:20:20.151 INFO:teuthology.orchestra.run.smithi053.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-09-28T00:20:20.166 INFO:teuthology.orchestra.run.smithi118.stdout:(120/120): librbd1-17.2.6-1161.g471b6dfd.el8.x8 6.5 MB/s | 3.6 MB 00:00 2023-09-28T00:20:20.171 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-09-28T00:20:20.171 INFO:teuthology.orchestra.run.smithi118.stdout:Total 14 MB/s | 201 MB 00:13 2023-09-28T00:20:20.176 INFO:teuthology.orchestra.run.smithi053.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 19 MB/s | 538 kB 00:00 2023-09-28T00:20:20.179 INFO:teuthology.orchestra.run.smithi053.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2023-09-28T00:20:20.192 INFO:teuthology.orchestra.run.smithi053.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.7 MB/s | 157 kB 00:00 2023-09-28T00:20:20.195 INFO:teuthology.orchestra.run.smithi053.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.8 MB/s | 110 kB 00:00 2023-09-28T00:20:20.209 INFO:teuthology.orchestra.run.smithi053.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.4 MB/s | 20 kB 00:00 2023-09-28T00:20:20.215 INFO:teuthology.orchestra.run.smithi053.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 16 MB/s | 353 kB 00:00 2023-09-28T00:20:20.222 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-09-28T00:20:20.233 INFO:teuthology.orchestra.run.smithi053.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.0 MB/s | 54 kB 00:00 2023-09-28T00:20:20.248 INFO:teuthology.orchestra.run.smithi053.stdout:(114/120): python3-numpy-1.14.3-9.el8.x86_64.rp 32 MB/s | 3.7 MB 00:00 2023-09-28T00:20:20.254 INFO:teuthology.orchestra.run.smithi053.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 16 MB/s | 709 kB 00:00 2023-09-28T00:20:20.293 INFO:teuthology.orchestra.run.smithi053.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2023-09-28T00:20:20.335 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-09-28T00:20:20.335 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-09-28T00:20:20.369 INFO:teuthology.orchestra.run.smithi053.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 35 MB/s | 4.7 MB 00:00 2023-09-28T00:20:20.392 INFO:teuthology.orchestra.run.smithi053.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 32 MB/s | 4.6 MB 00:00 2023-09-28T00:20:20.627 INFO:teuthology.orchestra.run.smithi053.stdout:(119/120): librbd1-17.2.6-1161.g471b6dfd.el8.x8 14 MB/s | 3.6 MB 00:00 2023-09-28T00:20:21.109 INFO:teuthology.orchestra.run.smithi053.stdout:(120/120): librados2-17.2.6-1161.g471b6dfd.el8. 4.2 MB/s | 3.5 MB 00:00 2023-09-28T00:20:21.115 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2023-09-28T00:20:21.115 INFO:teuthology.orchestra.run.smithi053.stdout:Total 16 MB/s | 201 MB 00:12 2023-09-28T00:20:21.191 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2023-09-28T00:20:21.326 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2023-09-28T00:20:21.326 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2023-09-28T00:20:22.151 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-09-28T00:20:22.155 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-09-28T00:20:23.165 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2023-09-28T00:20:23.181 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2023-09-28T00:20:27.750 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-09-28T00:20:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2023-09-28T00:20:27.970 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-09-28T00:20:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-09-28T00:20:28.223 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-09-28T00:20:28.308 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-09-28T00:20:28.451 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-09-28T00:20:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-09-28T00:20:28.622 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-09-28T00:20:28.666 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-09-28T00:20:28.834 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-09-28T00:20:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-09-28T00:20:29.215 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-09-28T00:20:29.317 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:20:29.468 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:20:29.784 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:20:29.866 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:20:29.974 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:20:30.100 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:20:30.137 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:20:30.341 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:20:30.469 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:20:30.672 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:20:30.698 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:20:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-09-28T00:20:31.225 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:20:31.314 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:20:31.685 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/122 2023-09-28T00:20:31.767 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-09-28T00:20:31.932 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:20:32.081 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:20:32.315 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-09-28T00:20:32.382 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-09-28T00:20:32.520 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-09-28T00:20:32.575 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:20:32.682 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:20:32.687 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:20:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:20:32.974 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:20:32.987 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-09-28T00:20:33.102 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:20:33.140 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-09-28T00:20:33.291 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-09-28T00:20:33.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:20:33.490 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:20:33.564 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-09-28T00:20:33.666 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:20:33.740 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:20:33.826 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-09-28T00:20:33.931 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-09-28T00:20:33.968 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-09-28T00:20:34.107 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-09-28T00:20:34.142 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-09-28T00:20:34.261 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-09-28T00:20:34.273 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-09-28T00:20:34.432 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-09-28T00:20:34.541 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-09-28T00:20:35.091 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-09-28T00:20:35.096 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-09-28T00:20:35.282 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-09-28T00:20:35.283 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-09-28T00:20:35.813 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-09-28T00:20:35.927 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-09-28T00:20:35.999 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-09-28T00:20:36.090 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-09-28T00:20:36.754 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-09-28T00:20:36.992 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-09-28T00:20:37.061 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-09-28T00:20:37.251 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-09-28T00:20:37.273 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-09-28T00:20:37.470 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-09-28T00:20:37.544 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-09-28T00:20:37.748 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-09-28T00:20:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-09-28T00:20:37.948 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 26/122 2023-09-28T00:20:38.051 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-09-28T00:20:38.112 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 27/122 2023-09-28T00:20:38.319 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-09-28T00:20:38.379 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 28/122 2023-09-28T00:20:38.527 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 26/122 2023-09-28T00:20:38.588 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-09-28T00:20:38.685 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 27/122 2023-09-28T00:20:38.887 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-09-28T00:20:38.942 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 28/122 2023-09-28T00:20:39.098 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-09-28T00:20:39.950 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-09-28T00:20:40.304 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-09-28T00:20:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-09-28T00:20:40.922 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-09-28T00:20:41.249 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-09-28T00:20:41.532 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-09-28T00:20:41.643 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-09-28T00:20:41.992 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-09-28T00:20:43.406 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-09-28T00:20:43.618 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-09-28T00:20:43.790 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-09-28T00:20:43.985 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-09-28T00:20:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-09-28T00:20:44.247 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-09-28T00:20:44.283 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-09-28T00:20:44.477 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-09-28T00:20:44.504 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-09-28T00:20:44.715 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 38/122 2023-09-28T00:20:44.742 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 38/122 2023-09-28T00:20:44.905 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 39/122 2023-09-28T00:20:44.946 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 39/122 2023-09-28T00:20:45.177 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 40/122 2023-09-28T00:20:45.222 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 40/122 2023-09-28T00:20:45.379 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-09-28T00:20:45.445 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-09-28T00:20:45.571 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-09-28T00:20:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-09-28T00:20:45.778 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-09-28T00:20:45.895 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-09-28T00:20:45.993 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-09-28T00:20:46.072 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-09-28T00:20:46.120 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-09-28T00:20:46.239 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-09-28T00:20:46.341 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-09-28T00:20:46.343 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-09-28T00:20:46.534 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-09-28T00:20:46.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-09-28T00:20:46.721 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-09-28T00:20:46.907 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-09-28T00:20:46.911 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-09-28T00:20:47.070 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-09-28T00:20:47.221 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-09-28T00:20:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-09-28T00:20:47.451 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-09-28T00:20:47.521 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-09-28T00:20:47.607 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-09-28T00:20:47.810 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-09-28T00:20:47.918 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-09-28T00:20:48.030 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-09-28T00:20:48.154 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-09-28T00:20:48.379 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-09-28T00:20:48.395 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-09-28T00:20:48.610 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-09-28T00:20:48.690 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-09-28T00:20:48.809 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-09-28T00:20:48.965 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-09-28T00:20:49.005 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-09-28T00:20:49.133 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-09-28T00:20:49.230 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-09-28T00:20:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-09-28T00:20:49.425 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-09-28T00:20:49.554 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-09-28T00:20:49.618 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-09-28T00:20:49.715 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-09-28T00:20:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-09-28T00:20:49.904 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-09-28T00:20:50.134 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-09-28T00:20:50.176 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-09-28T00:20:50.324 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-09-28T00:20:50.448 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-09-28T00:20:50.470 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-09-28T00:20:50.620 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-09-28T00:20:50.646 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-09-28T00:20:50.852 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-09-28T00:20:50.861 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-09-28T00:20:51.002 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-09-28T00:20:51.059 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-09-28T00:20:51.227 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-09-28T00:20:51.257 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-09-28T00:20:51.463 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-09-28T00:20:51.493 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-09-28T00:20:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-09-28T00:20:51.729 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-09-28T00:20:51.917 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-09-28T00:20:51.976 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-09-28T00:20:52.129 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-09-28T00:20:52.181 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-09-28T00:20:52.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-09-28T00:20:52.413 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-09-28T00:20:52.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-09-28T00:20:52.723 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-09-28T00:20:52.896 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-09-28T00:20:52.999 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-09-28T00:20:53.194 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-09-28T00:20:53.218 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-09-28T00:20:53.455 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-09-28T00:20:53.497 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-09-28T00:20:53.716 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-09-28T00:20:53.986 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-09-28T00:20:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-09-28T00:20:55.163 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-09-28T00:20:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-09-28T00:20:55.487 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-09-28T00:20:55.490 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-09-28T00:20:55.724 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-09-28T00:20:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-09-28T00:20:56.076 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-09-28T00:20:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-09-28T00:20:56.386 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-09-28T00:20:56.467 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-09-28T00:20:56.718 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-09-28T00:20:56.766 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-09-28T00:20:56.895 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-09-28T00:20:57.042 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-09-28T00:20:57.121 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-09-28T00:20:57.272 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-09-28T00:20:57.521 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-09-28T00:21:02.908 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:21:03.362 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:21:03.948 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:21:04.192 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:21:04.270 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:21:04.340 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:21:04.421 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:21:04.495 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:21:05.128 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:21:05.438 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:21:05.595 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:21:05.737 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:21:22.433 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:21:22.434 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-09-28T00:21:22.434 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-09-28T00:21:22.434 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-09-28T00:21:22.435 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:21:22.900 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:21:24.362 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:21:24.533 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:21:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:21:24.945 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:21:25.332 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:21:25.525 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:21:25.541 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:21:25.701 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:21:25.701 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /run 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-09-28T00:21:25.702 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:21:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:21:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:21:28.042 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:21:28.329 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:21:28.351 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:21:28.511 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:21:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:21:28.714 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 95/122 2023-09-28T00:21:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 96/122 2023-09-28T00:21:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:21:29.166 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:21:29.175 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:21:29.217 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:21:29.382 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:21:29.632 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:21:30.596 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:21:30.815 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:21:30.914 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:21:31.317 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 100/122 2023-09-28T00:21:31.516 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:21:31.552 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:21:31.757 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:21:31.768 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:21:33.332 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/122 2023-09-28T00:21:33.582 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:21:33.694 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:21:33.721 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:21:33.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:21:33.882 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:21:33.936 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:21:34.041 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:21:34.134 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 95/122 2023-09-28T00:21:34.313 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 96/122 2023-09-28T00:21:34.387 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:21:34.474 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:21:34.582 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:21:34.754 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:21:34.965 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:21:36.153 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:21:36.349 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:21:36.496 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:21:36.943 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 100/122 2023-09-28T00:21:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:21:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:21:37.332 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:21:37.360 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:21:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/122 2023-09-28T00:21:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:21:39.486 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:21:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:21:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:21:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:21:39.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 108/122 2023-09-28T00:21:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:21:40.089 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-09-28T00:21:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:21:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:21:40.783 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-09-28T00:21:41.148 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-09-28T00:21:41.364 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 111/122 2023-09-28T00:21:41.509 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-09-28T00:21:41.694 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 113/122 2023-09-28T00:21:41.860 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-09-28T00:21:42.064 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 115/122 2023-09-28T00:21:42.231 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/122 2023-09-28T00:21:42.399 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 117/122 2023-09-28T00:21:42.658 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-09-28T00:21:42.947 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-09-28T00:21:43.004 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-09-28T00:21:43.214 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-09-28T00:21:43.223 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-09-28T00:21:43.224 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:21:43.458 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:21:43.459 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:21:44.433 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:21:44.433 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 1/122 2023-09-28T00:21:44.433 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 3/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 5/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 12/122 2023-09-28T00:21:44.434 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 14/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 15/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 16/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 17/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 19/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 20/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 21/122 2023-09-28T00:21:44.435 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 22/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 23/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 24/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 25/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 26/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 27/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 28/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 29/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 30/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 31/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 32/122 2023-09-28T00:21:44.436 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 33/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 34/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 35/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 36/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 37/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 38/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-09-28T00:21:44.437 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-09-28T00:21:44.438 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-09-28T00:21:44.439 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-09-28T00:21:44.440 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-09-28T00:21:44.441 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-09-28T00:21:44.442 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-09-28T00:21:44.443 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-09-28T00:21:44.444 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 119/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-09-28T00:21:44.445 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/122 2023-09-28T00:21:46.334 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:21:46.914 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:21:46.915 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:49 ago on Thu 28 Sep 2023 12:19:57 AM UTC. 2023-09-28T00:21:47.767 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 108/122 2023-09-28T00:21:48.148 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-09-28T00:21:48.344 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 110/122 2023-09-28T00:21:48.585 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-09-28T00:21:48.764 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-09-28T00:21:48.792 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-09-28T00:21:48.937 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 113/122 2023-09-28T00:21:49.087 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-09-28T00:21:49.181 INFO:teuthology.orchestra.run.smithi118.stdout:Installed products updated. 2023-09-28T00:21:49.233 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 115/122 2023-09-28T00:21:49.329 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:21:49.329 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-09-28T00:21:49.329 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.329 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.329 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-09-28T00:21:49.330 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-7.el8.noarch 2023-09-28T00:21:49.330 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-09-28T00:21:49.330 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.330 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.330 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.331 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.331 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.331 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.331 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.331 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.332 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.332 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.332 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.332 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.332 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.333 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.334 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-09-28T00:21:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-09-28T00:21:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-12.el8.x86_64 2023-09-28T00:21:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T00:21:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.5-12.el8.x86_64 2023-09-28T00:21:49.335 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-09-28T00:21:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-09-28T00:21:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-28T00:21:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.336 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-09-28T00:21:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-09-28T00:21:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T00:21:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-09-28T00:21:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-28T00:21:49.337 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-09-28T00:21:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-28T00:21:49.338 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T00:21:49.339 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.12-1.el8.x86_64 2023-09-28T00:21:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-09-28T00:21:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-09-28T00:21:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-28T00:21:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-28T00:21:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-28T00:21:49.340 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-5.el8.noarch 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T00:21:49.342 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T00:21:49.343 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T00:21:49.344 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T00:21:49.345 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.3.3-2.el8.x86_64 2023-09-28T00:21:49.346 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T00:21:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-09-28T00:21:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T00:21:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-09-28T00:21:49.347 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:21:49.347 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-09-28T00:21:49.450 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/122 2023-09-28T00:21:49.556 DEBUG:teuthology.parallel:result is None 2023-09-28T00:21:49.726 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 117/122 2023-09-28T00:21:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-09-28T00:21:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-09-28T00:21:50.139 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-09-28T00:21:50.163 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-09-28T00:21:50.301 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-09-28T00:21:50.301 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:21:50.546 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:21:50.546 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:21:50.974 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:21:50.975 INFO:teuthology.orchestra.run.smithi053.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-28T00:21:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:21:51.946 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 1/122 2023-09-28T00:21:51.946 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2/122 2023-09-28T00:21:51.946 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 3/122 2023-09-28T00:21:51.946 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 5/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:21:51.947 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/122 2023-09-28T00:21:51.948 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 12/122 2023-09-28T00:21:51.948 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:21:51.948 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 14/122 2023-09-28T00:21:51.948 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 15/122 2023-09-28T00:21:51.948 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 16/122 2023-09-28T00:21:51.948 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 17/122 2023-09-28T00:21:51.949 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/122 2023-09-28T00:21:51.949 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 19/122 2023-09-28T00:21:51.949 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 20/122 2023-09-28T00:21:51.949 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 21/122 2023-09-28T00:21:51.949 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 22/122 2023-09-28T00:21:51.950 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 23/122 2023-09-28T00:21:51.950 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 24/122 2023-09-28T00:21:51.950 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 25/122 2023-09-28T00:21:51.950 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 26/122 2023-09-28T00:21:51.950 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 27/122 2023-09-28T00:21:51.951 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 28/122 2023-09-28T00:21:51.951 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 29/122 2023-09-28T00:21:51.951 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 30/122 2023-09-28T00:21:51.951 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 31/122 2023-09-28T00:21:51.951 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 32/122 2023-09-28T00:21:51.951 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 33/122 2023-09-28T00:21:51.952 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 34/122 2023-09-28T00:21:51.952 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 35/122 2023-09-28T00:21:51.952 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 36/122 2023-09-28T00:21:51.952 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 37/122 2023-09-28T00:21:51.952 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 38/122 2023-09-28T00:21:51.952 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-09-28T00:21:51.953 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-09-28T00:21:51.953 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-09-28T00:21:51.953 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-09-28T00:21:51.953 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-09-28T00:21:51.953 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-09-28T00:21:51.953 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-09-28T00:21:51.954 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-09-28T00:21:51.954 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-09-28T00:21:51.954 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-09-28T00:21:51.954 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-09-28T00:21:51.954 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-09-28T00:21:51.955 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-09-28T00:21:51.955 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-09-28T00:21:51.955 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-09-28T00:21:51.955 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-09-28T00:21:51.955 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-09-28T00:21:51.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-09-28T00:21:51.957 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-09-28T00:21:51.958 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-09-28T00:21:51.959 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-09-28T00:21:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-09-28T00:21:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 119/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-09-28T00:21:51.962 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/122 2023-09-28T00:21:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:21:54.225 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:56 ago on Thu 28 Sep 2023 12:19:58 AM UTC. 2023-09-28T00:21:56.490 INFO:teuthology.orchestra.run.smithi053.stdout:Installed products updated. 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.1-7.el8.noarch 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.0.4-10.el8.x86_64 2023-09-28T00:21:56.627 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.628 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-09-28T00:21:56.629 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.1-9.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.7-12.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: jq-1.5-12.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-09-28T00:21:56.630 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T00:21:56.631 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.12-1.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T00:21:56.632 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.5.1-5.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T00:21:56.633 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T00:21:56.634 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.635 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T00:21:56.636 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.3.3-2.el8.x86_64 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-09-28T00:21:56.637 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T00:21:56.638 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-09-28T00:21:56.638 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:21:56.638 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-09-28T00:21:56.935 DEBUG:teuthology.parallel:result is None 2023-09-28T00:21:56.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:21:57.077 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T00:21:57.126 INFO:teuthology.orchestra.run.smithi053.stdout:17.2.6-1161.g471b6dfd.el8 2023-09-28T00:21:57.126 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1161.g471b6dfd.el8 2023-09-28T00:21:57.127 INFO:teuthology.task.install:The correct ceph version 17.2.6-1161.g471b6dfd is installed. 2023-09-28T00:21:57.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:21:57.266 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T00:21:57.287 INFO:teuthology.orchestra.run.smithi118.stdout:17.2.6-1161.g471b6dfd.el8 2023-09-28T00:21:57.287 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1161.g471b6dfd.el8 2023-09-28T00:21:57.287 INFO:teuthology.task.install:The correct ceph version 17.2.6-1161.g471b6dfd is installed. 2023-09-28T00:21:57.287 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-28T00:21:57.287 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:21:57.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T00:21:57.372 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:21:57.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T00:21:57.409 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-28T00:21:57.409 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:21:57.409 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T00:21:57.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T00:21:57.580 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:21:57.581 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T00:21:57.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T00:21:57.666 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-28T00:21:57.667 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:21:57.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T00:21:57.731 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T00:21:57.839 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:21:57.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T00:21:57.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T00:21:57.926 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-28T00:21:57.926 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:21:57.926 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T00:21:57.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T00:21:58.092 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:21:58.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T00:21:58.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T00:21:58.182 INFO:teuthology.run_tasks:Running task ceph... 2023-09-28T00:21:58.240 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-28T00:21:58.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2023-09-28T00:21:58.245 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-09-28T00:21:58.305 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-28T00:21:58.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T00:21:58.309 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T00:21:58.366 INFO:tasks.ceph:Creating extra log directories... 2023-09-28T00:21:58.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T00:21:58.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T00:21:58.436 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-28T00:21:58.436 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-28T00:21:58.436 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-28T00:21:58.436 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:21:58.436 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-28T00:21:58.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-28T00:21:58.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-28T00:21:58.738 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:21:58.739 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-28T00:21:58.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-28T00:21:58.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-28T00:21:58.906 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-28T00:21:58.907 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-28T00:21:58.907 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493', 'branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7403493', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-09-27-0906-quincy'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3538, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk+ADokjofcaAQ15aDVZR0SzTmNR+UFOQ9q5paoIYLZ6U59fptFsVBISPwCOiYvrLFgk3dVakmnDO6f++/la4g=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoY1tr6orhKPGlK6PizELJ1WN+qAsxT1pCaJnEHgjiNVpuw09qV9ZhKEsEdkxLImgVvqsGtPcbyyc2wT85wl5M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-27_19:23:53', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-28T00:21:58.908 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T00:21:58.912 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T00:21:58.953 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T00:21:58.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T00:21:59.048 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:21:59.048 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T00:21:59.084 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T00:21:59.084 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2023-09-28T00:21:59.162 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T00:21:59.162 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-28 00:21:51.283795147 +0000 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-28 00:19:03.889778075 +0000 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-28 00:19:03.889778075 +0000 2023-09-28T00:21:59.163 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-28T00:21:59.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T00:21:59.262 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-28T00:21:59.262 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-28T00:21:59.262 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000248047 s, 2.1 MB/s 2023-09-28T00:21:59.265 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T00:21:59.303 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-28 00:21:51.283795147 +0000 2023-09-28T00:21:59.381 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-28 00:19:04.656764465 +0000 2023-09-28T00:21:59.382 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-28 00:19:04.656764465 +0000 2023-09-28T00:21:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-28T00:21:59.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T00:21:59.482 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-28T00:21:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-28T00:21:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000187088 s, 2.7 MB/s 2023-09-28T00:21:59.485 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T00:21:59.524 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2023-09-28T00:21:59.602 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T00:21:59.602 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:21:59.602 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-09-28T00:21:59.602 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:21:59.602 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:21:59.603 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-28 00:21:51.283795147 +0000 2023-09-28T00:21:59.603 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-28 00:19:05.455750288 +0000 2023-09-28T00:21:59.603 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-28 00:19:05.455750288 +0000 2023-09-28T00:21:59.603 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-28T00:21:59.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T00:21:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-28T00:21:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-28T00:21:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000181488 s, 2.8 MB/s 2023-09-28T00:21:59.705 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T00:21:59.744 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2023-09-28T00:21:59.823 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T00:21:59.823 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:21:59.823 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-09-28T00:21:59.823 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:21:59.823 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:21:59.824 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-28 00:21:51.284795128 +0000 2023-09-28T00:21:59.824 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-28 00:19:06.215736802 +0000 2023-09-28T00:21:59.824 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-28 00:19:06.215736802 +0000 2023-09-28T00:21:59.824 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-28T00:21:59.824 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T00:21:59.923 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-28T00:21:59.923 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-28T00:21:59.923 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000173621 s, 2.9 MB/s 2023-09-28T00:21:59.925 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T00:21:59.964 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:21:59.965 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:21:59.965 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T00:21:59.980 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T00:21:59.980 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-09-28T00:22:00.034 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T00:22:00.034 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 216037 Links: 1 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 00:21:43.970365552 +0000 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 00:16:16.608618012 +0000 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 00:16:16.608618012 +0000 2023-09-28T00:22:00.035 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-09-28T00:22:00.036 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T00:22:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T00:22:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T00:22:00.097 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.1658e-05 s, 5.6 MB/s 2023-09-28T00:22:00.098 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T00:22:00.153 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-09-28T00:22:00.207 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T00:22:00.207 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:22:00.207 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 222387 Links: 1 2023-09-28T00:22:00.207 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:22:00.207 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:22:00.207 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 00:21:43.970365552 +0000 2023-09-28T00:22:00.208 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 00:16:17.070608114 +0000 2023-09-28T00:22:00.208 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 00:16:17.070608114 +0000 2023-09-28T00:22:00.208 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-09-28T00:22:00.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T00:22:00.268 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T00:22:00.268 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T00:22:00.268 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000100107 s, 5.1 MB/s 2023-09-28T00:22:00.269 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T00:22:00.324 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-09-28T00:22:00.378 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T00:22:00.378 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:22:00.378 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 220690 Links: 1 2023-09-28T00:22:00.378 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:22:00.379 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:22:00.379 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 00:21:43.970365552 +0000 2023-09-28T00:22:00.379 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 00:16:17.574597318 +0000 2023-09-28T00:22:00.379 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 00:16:17.574597318 +0000 2023-09-28T00:22:00.379 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-09-28T00:22:00.379 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T00:22:00.441 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T00:22:00.441 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T00:22:00.441 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 8.8068e-05 s, 5.8 MB/s 2023-09-28T00:22:00.442 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T00:22:00.497 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-09-28T00:22:00.550 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T00:22:00.551 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:22:00.551 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 225302 Links: 1 2023-09-28T00:22:00.551 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:22:00.551 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:22:00.551 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 00:21:43.970365552 +0000 2023-09-28T00:22:00.552 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 00:16:18.048587164 +0000 2023-09-28T00:22:00.552 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 00:16:18.048587164 +0000 2023-09-28T00:22:00.552 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-09-28T00:22:00.552 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T00:22:00.612 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T00:22:00.612 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T00:22:00.612 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000107917 s, 4.7 MB/s 2023-09-28T00:22:00.613 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T00:22:00.668 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:00.668 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-28T00:22:00.669 INFO:tasks.ceph:Generating config... 2023-09-28T00:22:00.670 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-28T00:22:00.671 INFO:tasks.ceph:[client] debug client = 20 2023-09-28T00:22:00.671 INFO:tasks.ceph:[client] debug ms = 1 2023-09-28T00:22:00.671 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-28T00:22:00.671 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-28T00:22:00.671 INFO:tasks.ceph:[global] lockdep = True 2023-09-28T00:22:00.671 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-28T00:22:00.671 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-28T00:22:00.671 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-28T00:22:00.672 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-28T00:22:00.673 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-28T00:22:00.673 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-28T00:22:00.674 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-28T00:22:00.674 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-28T00:22:00.674 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-28T00:22:00.674 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-28T00:22:00.674 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-28T00:22:00.674 INFO:tasks.ceph:Setting up mon.a... 2023-09-28T00:22:00.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-28T00:22:00.774 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2023-09-28T00:22:00.779 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-28T00:22:00.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T00:22:00.929 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.b', '172.21.15.118'), ('mon.c', '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]')] 2023-09-28T00:22:00.930 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]', 'lockdep': True, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-28T00:22:00.931 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:00.931 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T00:22:00.967 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --add b 172.21.15.118 --addv c '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:01.081 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:01.081 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 95448d9d-c293-4b2c-9850-98d8a7632343 2023-09-28T00:22:01.081 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = octopus 2023-09-28T00:22:01.081 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 95448d9d-c293-4b2c-9850-98d8a7632343 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2023-09-28T00:22:01.082373+0000 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:created 2023-09-28T00:22:01.082373+0000 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 15 (octopus) 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] mon.c 2023-09-28T00:22:01.082 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-28T00:22:01.084 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T00:22:01.119 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 95448d9d-c293-4b2c-9850-98d8a7632343... 2023-09-28T00:22:01.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T00:22:01.164 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T00:22:01.204 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-09-28T00:22:01.205 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T00:22:01.206 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-09-28T00:22:01.207 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-09-28T00:22:01.208 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.53,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: lockdep = True 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 95448d9d-c293-4b2c-9850-98d8a7632343 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-09-28T00:22:01.209 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.210 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.211 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2023-09-28T00:22:01.212 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 1/20 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-09-28T00:22:01.213 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.214 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.215 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-09-28T00:22:01.216 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-09-28T00:22:01.217 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.e] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.f] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-09-28T00:22:01.218 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-09-28T00:22:01.219 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-09-28T00:22:01.219 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-09-28T00:22:01.219 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-09-28T00:22:01.219 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-09-28T00:22:01.219 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-09-28T00:22:01.274 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2023-09-28T00:22:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2023-09-28T00:22:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2023-09-28T00:22:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2023-09-28T00:22:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: lockdep = True 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on skipped message = False 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 95448d9d-c293-4b2c-9850-98d8a7632343 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2023-09-28T00:22:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2023-09-28T00:22:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2023-09-28T00:22:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:22:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2023-09-28T00:22:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2023-09-28T00:22:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T00:22:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.e] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-09-28T00:22:01.287 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.f] 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-09-28T00:22:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-09-28T00:22:01.306 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-28T00:22:01.306 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-28T00:22:01.408 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-28T00:22:01.408 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:01.408 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-28T00:22:01.445 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:01.445 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-28T00:22:01.520 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:22:01.521 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:01.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T00:22:01.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T00:22:01.649 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:01.650 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:01.726 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:22:01.726 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:01.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T00:22:01.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T00:22:01.759 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:01.759 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:01.814 INFO:tasks.ceph:Setting up mon nodes... 2023-09-28T00:22:01.814 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-28T00:22:01.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-28T00:22:01.928 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-28T00:22:01.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T00:22:01.990 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T00:22:01.992 INFO:tasks.ceph:Setting up mds nodes... 2023-09-28T00:22:01.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-28T00:22:02.107 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-28T00:22:02.112 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-28T00:22:02.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-28T00:22:02.286 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-28T00:22:02.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-28T00:22:02.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-09-28T00:22:02.463 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-09-28T00:22:02.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-09-28T00:22:02.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-28T00:22:02.576 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-28T00:22:02.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-28T00:22:02.602 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-28T00:22:02.688 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-28T00:22:02.690 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-28T00:22:02.713 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-09-28T00:22:02.801 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-09-28T00:22:02.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-09-28T00:22:02.827 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-28T00:22:02.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-28T00:22:02.913 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-28T00:22:02.944 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-28T00:22:02.944 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-28T00:22:02.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-28T00:22:03.007 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:03.007 INFO:tasks.ceph:role: osd.0 2023-09-28T00:22:03.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:22:03.007 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T00:22:03.068 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 2023-09-28T00:22:03.069 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:03.069 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:03.069 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:03.069 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:03.091 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-09-28T00:22:03.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-09-28T00:22:03.095 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-28T00:22:03.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-28T00:22:03.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-28T00:22:03.327 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:03.327 INFO:tasks.ceph:role: osd.1 2023-09-28T00:22:03.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:22:03.328 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T00:22:03.389 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:03.389 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:03.389 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:03.389 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 2023-09-28T00:22:03.389 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:03.389 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:03.390 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:03.390 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:03.390 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:03.390 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:03.412 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-09-28T00:22:03.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-09-28T00:22:03.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-28T00:22:03.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-28T00:22:03.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-28T00:22:03.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:03.644 INFO:tasks.ceph:role: osd.2 2023-09-28T00:22:03.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:22:03.644 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T00:22:03.705 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:03.705 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:03.705 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:03.705 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 2023-09-28T00:22:03.705 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:03.706 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:03.706 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:03.706 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:03.706 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:03.706 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:03.729 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-09-28T00:22:03.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-09-28T00:22:03.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-28T00:22:03.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-28T00:22:03.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-28T00:22:03.959 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:03.960 INFO:tasks.ceph:role: osd.3 2023-09-28T00:22:03.960 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:22:03.960 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:04.021 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:04.022 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:04.045 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-09-28T00:22:04.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-09-28T00:22:04.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-28T00:22:04.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-28T00:22:04.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.323+0000 7f15efc22540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-28T00:22:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.324+0000 7f15efc22540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-28T00:22:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.324+0000 7f15efc22540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T00:22:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.324+0000 7f15efc22540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T00:22:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.324+0000 7f15efc22540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T00:22:04.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.326+0000 7f15efc22540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-28T00:22:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:04.868+0000 7f15efc22540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:05.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:05.626+0000 7f15efc22540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:06.389+0000 7f15efc22540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:07.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-28T00:22:07.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.372+0000 7f0f4351a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-28T00:22:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.373+0000 7f0f4351a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-28T00:22:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.373+0000 7f0f4351a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T00:22:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.373+0000 7f0f4351a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T00:22:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.373+0000 7f0f4351a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T00:22:07.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.374+0000 7f0f4351a540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-28T00:22:07.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:07.909+0000 7f0f4351a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:08.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:08.671+0000 7f0f4351a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:09.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:09.433+0000 7f0f4351a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:10.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-28T00:22:10.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.421+0000 7f2dbac9d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-28T00:22:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.421+0000 7f2dbac9d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-28T00:22:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.421+0000 7f2dbac9d540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T00:22:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.421+0000 7f2dbac9d540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T00:22:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.421+0000 7f2dbac9d540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T00:22:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.423+0000 7f2dbac9d540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-28T00:22:10.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:10.961+0000 7f2dbac9d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:11.719+0000 7f2dbac9d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:12.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:12.481+0000 7f2dbac9d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:13.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-28T00:22:13.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:13.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.451+0000 7fd473092540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-28T00:22:13.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.452+0000 7fd473092540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-28T00:22:13.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.452+0000 7fd473092540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T00:22:13.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.452+0000 7fd473092540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T00:22:13.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.452+0000 7fd473092540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T00:22:13.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.453+0000 7fd473092540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-28T00:22:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:13.994+0000 7fd473092540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:14.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:14.755+0000 7fd473092540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:15.519+0000 7fd473092540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:16.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-28T00:22:16.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-28T00:22:16.423 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:16.423 INFO:tasks.ceph:role: osd.4 2023-09-28T00:22:16.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:22:16.424 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T00:22:16.486 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:16.486 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:16.487 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:16.509 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T00:22:16.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T00:22:16.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-28T00:22:16.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-28T00:22:16.654 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-28T00:22:16.718 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:16.718 INFO:tasks.ceph:role: osd.5 2023-09-28T00:22:16.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:22:16.718 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T00:22:16.783 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:16.784 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:16.785 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:16.785 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:16.806 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T00:22:16.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T00:22:16.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-28T00:22:16.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-28T00:22:16.950 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-28T00:22:17.015 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:17.015 INFO:tasks.ceph:role: osd.6 2023-09-28T00:22:17.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:22:17.015 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:17.078 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:17.079 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:17.079 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:17.101 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T00:22:17.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T00:22:17.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-28T00:22:17.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-28T00:22:17.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-28T00:22:17.309 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:22:17.309 INFO:tasks.ceph:role: osd.7 2023-09-28T00:22:17.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:22:17.310 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-28T00:22:17.372 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:22:17.372 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:22:17.372 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:22:17.372 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-09-28T00:22:17.373 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:22:17.373 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:22:17.373 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:22:17.373 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:22:17.373 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:22:17.373 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:22:17.395 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T00:22:17.397 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T00:22:17.397 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-28T00:22:17.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-28T00:22:17.539 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:17.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:17.618+0000 7f5a74f10540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-28T00:22:17.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:17.618+0000 7f5a74f10540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-28T00:22:17.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:17.618+0000 7f5a74f10540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T00:22:17.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:17.618+0000 7f5a74f10540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T00:22:17.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:17.618+0000 7f5a74f10540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T00:22:17.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:17.618+0000 7f5a74f10540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-28T00:22:18.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:18.150+0000 7f5a74f10540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:18.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:18.915+0000 7f5a74f10540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:19.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:19.684+0000 7f5a74f10540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:20.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-28T00:22:20.552 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:20.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:20.636+0000 7f7c75ef9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-28T00:22:20.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:20.636+0000 7f7c75ef9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-28T00:22:20.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:20.636+0000 7f7c75ef9540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T00:22:20.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:20.636+0000 7f7c75ef9540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T00:22:20.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:20.636+0000 7f7c75ef9540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T00:22:20.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:20.636+0000 7f7c75ef9540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-28T00:22:21.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:21.162+0000 7f7c75ef9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:21.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:21.931+0000 7f7c75ef9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:22.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:22.697+0000 7f7c75ef9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:23.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-28T00:22:23.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:23.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:23.655+0000 7fa18dcbb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-28T00:22:23.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:23.655+0000 7fa18dcbb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-28T00:22:23.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:23.655+0000 7fa18dcbb540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T00:22:23.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:23.655+0000 7fa18dcbb540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T00:22:23.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:23.655+0000 7fa18dcbb540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T00:22:23.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:23.656+0000 7fa18dcbb540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-28T00:22:24.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:24.180+0000 7fa18dcbb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:24.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:24.942+0000 7fa18dcbb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:25.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:25.708+0000 7fa18dcbb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:26.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-28T00:22:26.575 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:26.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:26.657+0000 7f573c6e2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-28T00:22:26.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:26.658+0000 7f573c6e2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-28T00:22:26.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:26.658+0000 7f573c6e2540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T00:22:26.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:26.658+0000 7f573c6e2540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T00:22:26.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:26.658+0000 7f573c6e2540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T00:22:26.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:26.658+0000 7f573c6e2540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-28T00:22:27.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:27.186+0000 7f573c6e2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:27.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:27.950+0000 7f573c6e2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:28.716 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:28.715+0000 7f573c6e2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:22:28.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:22:28.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:22:29.515 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-28T00:22:29.542 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-28T00:22:29.542 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:29.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-28T00:22:29.610 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:29.610 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-28T00:22:29.715 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:29.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-28T00:22:29.817 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:29.817 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-09-28T00:22:29.919 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:29.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-28T00:22:30.020 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:30.021 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-28T00:22:30.122 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:30.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-28T00:22:30.223 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:30.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-28T00:22:30.325 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-28T00:22:30.352 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.353 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-28T00:22:30.419 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.420 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-28T00:22:30.486 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-09-28T00:22:30.550 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.551 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-28T00:22:30.615 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-28T00:22:30.679 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.680 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-28T00:22:30.743 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:30.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-28T00:22:30.806 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:30.807 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-28T00:22:30.845 INFO:tasks.ceph:Adding keys to all mons... 2023-09-28T00:22:30.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T00:22:30.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T00:22:30.911 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2023-09-28T00:22:30.911 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQApxxRlR8VQNxAACNdBLN4QS3UQcepW12EIpw== 2023-09-28T00:22:30.911 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-09-28T00:22:30.911 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRlIXV6BhAAPxAWKNFdBFRMDS1tdfYDQg== 2023-09-28T00:22:30.911 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-09-28T00:22:30.911 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRlI8sgERAAlcdVd3mHRy2nNmozHoRM+w== 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.e] 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRlPlKvGxAA1lZzx6J/fYuM6ue5h8zHLg== 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAsxxRlPXNbExAAS4i8pXSlZrqYflyQVkZuxQ== 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAvxxRl39hGFhAAz52iXXC/YwaLTNY2z6Tkag== 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAyxxRlqVIsGRAA7Z526qtvj8sOcXjebbeOVQ== 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA1xxRlCVX7GhAAmQ3ibYVg+/uJbHReRu/Ltg== 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-09-28T00:22:30.912 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQApxxRls8gQOxAAcDDY6Qw5qmd5dPfpmzJQfw== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRlpANvIhAAZTYxDVvJdfeY8fNkhUFZoQ== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRlimscKRAAA4seuhS0XC5YnrSQKeN5Kw== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.f] 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRlrNjVLxAAtctGFti03Zzcnjnt9zdPAg== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA5xxRlmXDlJBAATK9SN3Aztn6LB/qy2ULhyg== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA8xxRlAnL7JRAAQ43BDIYvdleJpe+3WEEP/Q== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA/xxRlySEmJxAARHuAUUHbGo+LBsyRLGjGiQ== 2023-09-28T00:22:30.913 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2023-09-28T00:22:30.914 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBCxxRlzBtGJxAA6sbjYZBG3Py9qHAkVc9y3Q== 2023-09-28T00:22:30.914 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-09-28T00:22:30.914 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAqxxRl+eV6NhAAeEfXgvWyW3jgjxD2WnhVlw== 2023-09-28T00:22:30.944 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2023-09-28T00:22:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQApxxRlR8VQNxAACNdBLN4QS3UQcepW12EIpw== 2023-09-28T00:22:30.944 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRlIXV6BhAAPxAWKNFdBFRMDS1tdfYDQg== 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRlI8sgERAAlcdVd3mHRy2nNmozHoRM+w== 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.e] 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRlPlKvGxAA1lZzx6J/fYuM6ue5h8zHLg== 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAsxxRlPXNbExAAS4i8pXSlZrqYflyQVkZuxQ== 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAvxxRl39hGFhAAz52iXXC/YwaLTNY2z6Tkag== 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAyxxRlqVIsGRAA7Z526qtvj8sOcXjebbeOVQ== 2023-09-28T00:22:30.945 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA1xxRlCVX7GhAAmQ3ibYVg+/uJbHReRu/Ltg== 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQApxxRls8gQOxAAcDDY6Qw5qmd5dPfpmzJQfw== 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRlpANvIhAAZTYxDVvJdfeY8fNkhUFZoQ== 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRlimscKRAAA4seuhS0XC5YnrSQKeN5Kw== 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.f] 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRlrNjVLxAAtctGFti03Zzcnjnt9zdPAg== 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA5xxRlmXDlJBAATK9SN3Aztn6LB/qy2ULhyg== 2023-09-28T00:22:30.946 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8xxRlAnL7JRAAQ43BDIYvdleJpe+3WEEP/Q== 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA/xxRlySEmJxAARHuAUUHbGo+LBsyRLGjGiQ== 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBCxxRlzBtGJxAA6sbjYZBG3Py9qHAkVc9y3Q== 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-09-28T00:22:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAqxxRl+eV6NhAAeEfXgvWyW3jgjxD2WnhVlw== 2023-09-28T00:22:30.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:22:30.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:22:31.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.091 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.191 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.290 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.487 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:31.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:22:31.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:22:31.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:31.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:32.067 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:32.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:22:32.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.462 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:22:32.555 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:22:32.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:22:32.654 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-28T00:22:32.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-28T00:22:32.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T00:22:32.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-28T00:22:32.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-28T00:22:32.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T00:22:33.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-28T00:22:33.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-28T00:22:33.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T00:22:33.179 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-28T00:22:33.202 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:33.206 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:22:33.255 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-28T00:22:33.256 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-28T00:22:33.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-28T00:22:33.283 INFO:tasks.ceph.mon.a:Started 2023-09-28T00:22:33.283 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-28T00:22:33.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-28T00:22:33.298 INFO:tasks.ceph.mon.b:Started 2023-09-28T00:22:33.298 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-28T00:22:33.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-28T00:22:33.300 INFO:tasks.ceph.mon.c:Started 2023-09-28T00:22:33.300 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-28T00:22:33.300 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-28T00:22:33.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-28T00:22:33.304 INFO:tasks.ceph.mgr.y:Started 2023-09-28T00:22:33.305 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-28T00:22:33.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-28T00:22:33.306 INFO:tasks.ceph.mgr.x:Started 2023-09-28T00:22:33.307 INFO:tasks.ceph:Setting crush tunables to default 2023-09-28T00:22:33.307 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2023-09-28T00:22:33.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.494+0000 7f8da1b9d700 1 Processor -- start 2023-09-28T00:22:33.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.494+0000 7f8da1b9d700 1 -- start start 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.495+0000 7f8da1b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c8330 0x7f8d9c0c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.495+0000 7f8da1b9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d9c0c2b80 0x7f8d9c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da1b9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c155e10 con 0x7f8d9c0c2270 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da1b9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c156320 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da1b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c068150 con 0x7f8d9c0c8330 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8d9bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c8330 0x7f8d9c0c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da139c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d9c0c2b80 0x7f8d9c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da0b9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d9c0c2270 0x7f8d9c0688e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44648/0 (socket says 172.21.15.53:44648) 2023-09-28T00:22:33.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da0b9b700 1 -- 172.21.15.53:0/3671870769 learned_addr learned my addr 172.21.15.53:0/3671870769 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3671870769 >> v2:172.21.15.118:3300/0 conn(0x7f8d9c0c2b80 msgr2=0x7f8d9c14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8d9b7fe700 1 -- 172.21.15.53:0/3671870769 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280499610 0 0) 0x7f8d9c155e10 con 0x7f8d9c0c2270 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8d9bfff700 1 --2- 172.21.15.53:0/3671870769 >> v2:172.21.15.118:3300/0 conn(0x7f8d9c0c2b80 0x7f8d9c14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3671870769 >> v1:172.21.15.53:6789/0 conn(0x7f8d9c0c2270 legacy=0x7f8d9c0688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3671870769 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c156040 con 0x7f8d9c0c8330 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.496+0000 7f8da139c700 1 --2- 172.21.15.53:0/3671870769 >> v2:172.21.15.118:3300/0 conn(0x7f8d9c0c2b80 0x7f8d9c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:33.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8d9bfff700 1 --2- 172.21.15.53:0/3671870769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c8330 0x7f8d9c0c2640 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d880098e0 tx=0x7f8d880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45207e021be0c015 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8d9b7fe700 1 -- 172.21.15.53:0/3671870769 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800b6d0 con 0x7f8d9c0c8330 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8d9b7fe700 1 -- 172.21.15.53:0/3671870769 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800b830 con 0x7f8d9c0c8330 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8d9b7fe700 1 -- 172.21.15.53:0/3671870769 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800bbd0 con 0x7f8d9c0c8330 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3671870769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c8330 msgr2=0x7f8d9c0c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3671870769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c8330 0x7f8d9c0c2640 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d880098e0 tx=0x7f8d880091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3671870769 shutdown_connections 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.497+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3671870769 >> v2:172.21.15.118:3300/0 conn(0x7f8d9c0c2b80 0x7f8d9c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.498+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3671870769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c8330 0x7f8d9c0c2640 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.498+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3671870769 >> 172.21.15.53:0/3671870769 conn(0x7f8d9c0cbdf0 msgr2=0x7f8d9c0cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.498+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3671870769 shutdown_connections 2023-09-28T00:22:33.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.498+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3671870769 wait complete. 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.499+0000 7f8da1b9d700 1 Processor -- start 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.499+0000 7f8da1b9d700 1 -- start start 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da1b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9c0c2270 0x7f8d9c0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da1b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 0x7f8d9c0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da1b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9c0c8330 0x7f8d9c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da1b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c14bbf0 con 0x7f8d9c0c8330 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da1b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c15a0d0 con 0x7f8d9c0c2270 2023-09-28T00:22:33.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da1b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c165de0 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da0b9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9c0c2270 0x7f8d9c0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8da139c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9c0c8330 0x7f8d9c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8d9bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 0x7f8d9c0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8d9bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 0x7f8d9c0c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:52520/0 (socket says 172.21.15.53:52520) 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3743319140 learned_addr learned my addr 172.21.15.53:0/3743319140 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9c0c2270 msgr2=0x7f8d9c0c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8d9bfff700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9c0c2270 0x7f8d9c0c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.500+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3743319140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9c0c8330 msgr2=0x7f8d9c0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d9bfff700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9c0c8330 0x7f8d9c0c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d9bfff700 1 -- 172.21.15.53:0/3743319140 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009a20 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d9bfff700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 0x7f8d9c0c5870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d880093f0 tx=0x7f8d88017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:33.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800bbb0 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d88011420 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d88009420 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880117c0 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c15b160 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8d8802e3f0 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.501+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8d88025740 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.502+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c165f20 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.505+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f8d9c165f20 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.583+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8d9c04c3c0 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.586+0000 7f8d98ff9700 1 -- 172.21.15.53:0/3743319140 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8d88033060 con 0x7f8d9c0c2b80 2023-09-28T00:22:33.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 msgr2=0x7f8d9c0c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:33.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 0x7f8d9c0c5870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8d880093f0 tx=0x7f8d88017000 comp rx=0 tx=0).stop 2023-09-28T00:22:33.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 shutdown_connections 2023-09-28T00:22:33.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9c0c8330 0x7f8d9c0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d9c0c2270 0x7f8d9c0c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 --2- 172.21.15.53:0/3743319140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d9c0c2b80 0x7f8d9c0c5870 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:33.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 >> 172.21.15.53:0/3743319140 conn(0x7f8d9c0cbdf0 msgr2=0x7f8d9c155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:33.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 shutdown_connections 2023-09-28T00:22:33.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:33.587+0000 7f8da1b9d700 1 -- 172.21.15.53:0/3743319140 wait complete. 2023-09-28T00:22:33.588 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2023-09-28T00:22:33.604 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-28T00:22:33.604 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:33.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-28T00:22:33.666 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:33.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-28T00:22:33.769 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:33.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-28T00:22:33.871 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-28T00:22:33.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-28T00:22:33.973 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:33.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-28T00:22:33.997 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:33.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-28T00:22:34.060 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:34.060 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-28T00:22:34.124 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T00:22:34.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-28T00:22:34.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 4dabe882-062f-45b6-90f4-0fa4237378af 0 2023-09-28T00:22:34.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.346+0000 7f8e3d4f0700 1 Processor -- start 2023-09-28T00:22:34.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.346+0000 7f8e3d4f0700 1 -- start start 2023-09-28T00:22:34.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e3d4f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e380c7b90 0x7f8e381597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e3d4f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 0x7f8e380c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e3d4f0700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e3814f710 0x7f8e3814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e3d4f0700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380c8990 con 0x7f8e3814f710 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e3d4f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e38159d00 con 0x7f8e380c7b90 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e3d4f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c6e60 con 0x7f8e380c7f60 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e367fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 0x7f8e380c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e380c7b90 0x7f8e381597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e367fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 0x7f8e380c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53244/0 (socket says 172.21.15.118:53244) 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e380c7b90 0x7f8e381597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60468/0 (socket says 172.21.15.118:60468) 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e367fc700 1 -- 172.21.15.118:0/793224087 learned_addr learned my addr 172.21.15.118:0/793224087 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e377fe700 1 --2- 172.21.15.118:0/793224087 >> v2:172.21.15.53:3300/0 conn(0x7f8e3814f710 0x7f8e3814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 -- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 msgr2=0x7f8e380c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 --2- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 0x7f8e380c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 -- 172.21.15.118:0/793224087 >> v2:172.21.15.53:3300/0 conn(0x7f8e3814f710 msgr2=0x7f8e3814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 --2- 172.21.15.118:0/793224087 >> v2:172.21.15.53:3300/0 conn(0x7f8e3814f710 0x7f8e3814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 -- 172.21.15.118:0/793224087 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380c8ba0 con 0x7f8e380c7b90 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e367fc700 1 --2- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 0x7f8e380c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e36ffd700 1 --2- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7b90 0x7f8e381597c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8e38088d30 tx=0x7f8e2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b176fb412f12c89 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e35ffb700 1 -- 172.21.15.118:0/793224087 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00b690 con 0x7f8e380c7b90 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.347+0000 7f8e35ffb700 1 -- 172.21.15.118:0/793224087 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00b7f0 con 0x7f8e380c7b90 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e35ffb700 1 -- 172.21.15.118:0/793224087 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00bb90 con 0x7f8e380c7b90 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7b90 msgr2=0x7f8e381597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7b90 0x7f8e381597c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8e38088d30 tx=0x7f8e2c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/793224087 shutdown_connections 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/793224087 >> v2:172.21.15.53:3300/0 conn(0x7f8e3814f710 0x7f8e3814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7b90 0x7f8e381597c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/793224087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e380c7f60 0x7f8e380c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/793224087 >> 172.21.15.118:0/793224087 conn(0x7f8e3806ed60 msgr2=0x7f8e3806f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/793224087 shutdown_connections 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.348+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/793224087 wait complete. 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 Processor -- start 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 -- start start 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e380c7b90 0x7f8e3814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 0x7f8e38151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 0x7f8e38152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38169f00 con 0x7f8e380c7b90 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38165c40 con 0x7f8e380c7f60 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e3d4f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38165f20 con 0x7f8e3814f710 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e377fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 0x7f8e38152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e367fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 0x7f8e38151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e367fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 0x7f8e38151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60476/0 (socket says 172.21.15.118:60476) 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e367fc700 1 -- 172.21.15.118:0/2833143883 learned_addr learned my addr 172.21.15.118:0/2833143883 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e377fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 0x7f8e38152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53252/0 (socket says 172.21.15.118:53252) 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.350+0000 7f8e36ffd700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e380c7b90 0x7f8e3814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e367fc700 1 -- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 msgr2=0x7f8e38152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e367fc700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 0x7f8e38152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e367fc700 1 -- 172.21.15.118:0/2833143883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e380c7b90 msgr2=0x7f8e3814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e367fc700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e380c7b90 0x7f8e3814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e367fc700 1 -- 172.21.15.118:0/2833143883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280094f0 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e377fe700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 0x7f8e38152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e367fc700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 0x7f8e38151dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800ec50 tx=0x7f8e28009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800c9b0 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800cb10 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800ce90 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c009420 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e381664e0 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8e28005c80 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.351+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8e28006370 con 0x7f8e380c7f60 2023-09-28T00:22:34.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.352+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e38071830 con 0x7f8e380c7f60 2023-09-28T00:22:34.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.354+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f8e28021060 con 0x7f8e380c7f60 2023-09-28T00:22:34.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.436+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4dabe882-062f-45b6-90f4-0fa4237378af", "id": 0} v 0) v1 -- 0x7f8e38068830 con 0x7f8e380c7f60 2023-09-28T00:22:34.440 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.440+0000 7f8e1effd700 1 -- 172.21.15.118:0/2833143883 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dabe882-062f-45b6-90f4-0fa4237378af", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e28017070 con 0x7f8e380c7f60 2023-09-28T00:22:34.440 INFO:teuthology.orchestra.run.smithi118.stdout:0 2023-09-28T00:22:34.441 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 msgr2=0x7f8e38151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 0x7f8e38151dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800ec50 tx=0x7f8e28009250 comp rx=0 tx=0).stop 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 shutdown_connections 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e3814f710 0x7f8e38152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e380c7b90 0x7f8e3814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 --2- 172.21.15.118:0/2833143883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e380c7f60 0x7f8e38151dc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 >> 172.21.15.118:0/2833143883 conn(0x7f8e3806ed60 msgr2=0x7f8e3815a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 shutdown_connections 2023-09-28T00:22:34.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.441+0000 7f8e3d4f0700 1 -- 172.21.15.118:0/2833143883 wait complete. 2023-09-28T00:22:34.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new ac81b9ba-2f2b-4ac7-89b3-15f5959294e0 1 2023-09-28T00:22:34.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.567+0000 7efeeefce700 1 Processor -- start 2023-09-28T00:22:34.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.567+0000 7efeeefce700 1 -- start start 2023-09-28T00:22:34.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeeefce700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 0x7efee80c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeeefce700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efee80c2b80 0x7efee814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeeefce700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee8155e10 con 0x7efee80c2270 2023-09-28T00:22:34.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeeefce700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee8156320 con 0x7efee80c2b80 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeeefce700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee8068150 con 0x7efee80c8330 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeed7cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 0x7efee80c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeee7cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efee80c2b80 0x7efee814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeed7cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 0x7efee80c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53254/0 (socket says 172.21.15.118:53254) 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeed7cb700 1 -- 172.21.15.118:0/1434022667 learned_addr learned my addr 172.21.15.118:0/1434022667 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeee7cd700 1 -- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 msgr2=0x7efee80c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeee7cd700 1 --2- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 0x7efee80c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeee7cd700 1 -- 172.21.15.118:0/1434022667 >> v1:172.21.15.118:6789/0 conn(0x7efee80c2270 legacy=0x7efee80688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeee7cd700 1 -- 172.21.15.118:0/1434022667 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8156040 con 0x7efee80c2b80 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeed7cb700 1 --2- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 0x7efee80c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeee7cd700 1 --2- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c2b80 0x7efee814ed30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efee0009e60 tx=0x7efee0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35c8befb4600f24 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeecfca700 1 -- 172.21.15.118:0/1434022667 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000e070 con 0x7efee80c2b80 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeecfca700 1 -- 172.21.15.118:0/1434022667 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000bbf0 con 0x7efee80c2b80 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.568+0000 7efeecfca700 1 -- 172.21.15.118:0/1434022667 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0012430 con 0x7efee80c2b80 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 -- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c2b80 msgr2=0x7efee814ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 --2- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c2b80 0x7efee814ed30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efee0009e60 tx=0x7efee0009780 comp rx=0 tx=0).stop 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 -- 172.21.15.118:0/1434022667 shutdown_connections 2023-09-28T00:22:34.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 --2- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c2b80 0x7efee814ed30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 --2- 172.21.15.118:0/1434022667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c8330 0x7efee80c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 -- 172.21.15.118:0/1434022667 >> 172.21.15.118:0/1434022667 conn(0x7efee80cbdf0 msgr2=0x7efee80cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:34.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 -- 172.21.15.118:0/1434022667 shutdown_connections 2023-09-28T00:22:34.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.569+0000 7efeeefce700 1 -- 172.21.15.118:0/1434022667 wait complete. 2023-09-28T00:22:34.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.570+0000 7efeeefce700 1 Processor -- start 2023-09-28T00:22:34.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.570+0000 7efeeefce700 1 -- start start 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efee80c2270 0x7efee80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 0x7efee81687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c8330 0x7efee8146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80afde0 con 0x7efee80c2270 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80aeb90 con 0x7efee80c8330 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80af3f0 con 0x7efee80c2b80 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 0x7efee81687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeee7cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c8330 0x7efee8146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 0x7efee81687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53262/0 (socket says 172.21.15.118:53262) 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 -- 172.21.15.118:0/2472298823 learned_addr learned my addr 172.21.15.118:0/2472298823 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:34.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeedfcc700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efee80c2270 0x7efee80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 -- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c8330 msgr2=0x7efee8146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c8330 0x7efee8146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 -- 172.21.15.118:0/2472298823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efee80c2270 msgr2=0x7efee80c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efee80c2270 0x7efee80c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 -- 172.21.15.118:0/2472298823 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80094f0 con 0x7efee80c2b80 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeee7cd700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c8330 0x7efee8146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeedfcc700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efee80c2270 0x7efee80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeed7cb700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 0x7efee81687d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efed800ec50 tx=0x7efed8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800c850 con 0x7efee80c2b80 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed800c9b0 con 0x7efee80c2b80 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800cd30 con 0x7efee80c2b80 2023-09-28T00:22:34.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.571+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee0009a20 con 0x7efee80c2b80 2023-09-28T00:22:34.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.572+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee80af880 con 0x7efee80c2b80 2023-09-28T00:22:34.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.572+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efed8013680 con 0x7efee80c2b80 2023-09-28T00:22:34.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.572+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7efed801c8a0 con 0x7efee80c2b80 2023-09-28T00:22:34.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.573+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee804c3c0 con 0x7efee80c2b80 2023-09-28T00:22:34.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.576+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7efed803b6b0 con 0x7efee80c2b80 2023-09-28T00:22:34.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.659+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac81b9ba-2f2b-4ac7-89b3-15f5959294e0", "id": 1} v 0) v1 -- 0x7efee80af530 con 0x7efee80c2b80 2023-09-28T00:22:34.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.662+0000 7efeddffb700 1 -- 172.21.15.118:0/2472298823 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac81b9ba-2f2b-4ac7-89b3-15f5959294e0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7efed802a070 con 0x7efee80c2b80 2023-09-28T00:22:34.663 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 msgr2=0x7efee81687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 0x7efee81687d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efed800ec50 tx=0x7efed8009250 comp rx=0 tx=0).stop 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 shutdown_connections 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee80c8330 0x7efee8146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efee80c2270 0x7efee80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 --2- 172.21.15.118:0/2472298823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efee80c2b80 0x7efee81687d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.663+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 >> 172.21.15.118:0/2472298823 conn(0x7efee80cbdf0 msgr2=0x7efee814e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.664+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 shutdown_connections 2023-09-28T00:22:34.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.664+0000 7efeeefce700 1 -- 172.21.15.118:0/2472298823 wait complete. 2023-09-28T00:22:34.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 5628779f-7bc6-4ba2-b491-6c55e8d67390 2 2023-09-28T00:22:34.760 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:34.760+0000 7fe080df3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T00:22:34.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.789+0000 7f6b2cb4d700 1 Processor -- start 2023-09-28T00:22:34.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.789+0000 7f6b2cb4d700 1 -- start start 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2cb4d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 0x7f6b280c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2cb4d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b2814faa0 0x7f6b28069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2cb4d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280ca720 con 0x7f6b2806d110 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2cb4d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2806cc80 con 0x7f6b2814faa0 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2cb4d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280ca950 con 0x7f6b2814f6d0 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 0x7f6b280c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 0x7f6b280c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53266/0 (socket says 172.21.15.118:53266) 2023-09-28T00:22:34.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.790+0000 7f6b2659c700 1 -- 172.21.15.118:0/1694850682 learned_addr learned my addr 172.21.15.118:0/1694850682 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b25d9b700 1 --2- 172.21.15.118:0/1694850682 >> v2:172.21.15.53:3300/0 conn(0x7f6b2814faa0 0x7f6b28069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2659c700 1 -- 172.21.15.118:0/1694850682 >> v2:172.21.15.53:3300/0 conn(0x7f6b2814faa0 msgr2=0x7f6b28069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2659c700 1 --2- 172.21.15.118:0/1694850682 >> v2:172.21.15.53:3300/0 conn(0x7f6b2814faa0 0x7f6b28069150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2659c700 1 -- 172.21.15.118:0/1694850682 >> v1:172.21.15.53:6789/0 conn(0x7f6b2806d110 legacy=0x7f6b28155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2659c700 1 -- 172.21.15.118:0/1694850682 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280c4c50 con 0x7f6b2814f6d0 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b25d9b700 1 --2- 172.21.15.118:0/1694850682 >> v2:172.21.15.53:3300/0 conn(0x7f6b2814faa0 0x7f6b28069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:22:34.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2659c700 1 --2- 172.21.15.118:0/1694850682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 0x7f6b280c4710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b100099b0 tx=0x7f6b10009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6395c2406bdd683 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2559a700 1 -- 172.21.15.118:0/1694850682 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000b820 con 0x7f6b2814f6d0 2023-09-28T00:22:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2559a700 1 -- 172.21.15.118:0/1694850682 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000b980 con 0x7f6b2814f6d0 2023-09-28T00:22:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2559a700 1 -- 172.21.15.118:0/1694850682 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000bd20 con 0x7f6b2814f6d0 2023-09-28T00:22:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/1694850682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 msgr2=0x7f6b280c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.791+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/1694850682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 0x7f6b280c4710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b100099b0 tx=0x7f6b10009250 comp rx=0 tx=0).stop 2023-09-28T00:22:34.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.792+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/1694850682 shutdown_connections 2023-09-28T00:22:34.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.792+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/1694850682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2814f6d0 0x7f6b280c4710 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.792+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/1694850682 >> v2:172.21.15.53:3300/0 conn(0x7f6b2814faa0 0x7f6b28069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.792+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/1694850682 >> 172.21.15.118:0/1694850682 conn(0x7f6b28068100 msgr2=0x7f6b280c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:34.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.792+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/1694850682 shutdown_connections 2023-09-28T00:22:34.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.792+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/1694850682 wait complete. 2023-09-28T00:22:34.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 Processor -- start 2023-09-28T00:22:34.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 -- start start 2023-09-28T00:22:34.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 0x7f6b2806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 0x7f6b28165760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2814faa0 0x7f6b28165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:34.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280c8230 con 0x7f6b2814faa0 2023-09-28T00:22:34.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2815aa90 con 0x7f6b2814f6d0 2023-09-28T00:22:34.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2cb4d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b281652d0 con 0x7f6b2806d110 2023-09-28T00:22:34.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 0x7f6b2806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b25d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 0x7f6b28165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 0x7f6b2806b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53272/0 (socket says 172.21.15.118:53272) 2023-09-28T00:22:34.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b25d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 0x7f6b28165760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60500/0 (socket says 172.21.15.118:60500) 2023-09-28T00:22:34.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b2659c700 1 -- 172.21.15.118:0/2338671078 learned_addr learned my addr 172.21.15.118:0/2338671078 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:34.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.793+0000 7f6b26d9d700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2814faa0 0x7f6b28165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:34.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b25d9b700 1 -- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 msgr2=0x7f6b2806b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b25d9b700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 0x7f6b2806b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b25d9b700 1 -- 172.21.15.118:0/2338671078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2814faa0 msgr2=0x7f6b28165ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b25d9b700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2814faa0 0x7f6b28165ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b25d9b700 1 -- 172.21.15.118:0/2338671078 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100094f0 con 0x7f6b2814f6d0 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b2659c700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 0x7f6b2806b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b25d9b700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 0x7f6b28165760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800c880 tx=0x7f6b18008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:34.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18011600 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b18011760 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18011b40 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2815a7f0 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b28169530 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6b1801a450 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.794+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f6b180197e0 con 0x7f6b2814f6d0 2023-09-28T00:22:34.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.795+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b281690c0 con 0x7f6b2814f6d0 2023-09-28T00:22:34.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.797+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f6b1801f060 con 0x7f6b2814f6d0 2023-09-28T00:22:34.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.879+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5628779f-7bc6-4ba2-b491-6c55e8d67390", "id": 2} v 0) v1 -- 0x7f6b28165440 con 0x7f6b2814f6d0 2023-09-28T00:22:34.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.883+0000 7f6b1e7fc700 1 -- 172.21.15.118:0/2338671078 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5628779f-7bc6-4ba2-b491-6c55e8d67390", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b18015070 con 0x7f6b2814f6d0 2023-09-28T00:22:34.883 INFO:teuthology.orchestra.run.smithi118.stdout:2 2023-09-28T00:22:34.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 msgr2=0x7f6b28165760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:34.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 0x7f6b28165760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800c880 tx=0x7f6b18008040 comp rx=0 tx=0).stop 2023-09-28T00:22:34.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 shutdown_connections 2023-09-28T00:22:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d110 0x7f6b2806b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2814faa0 0x7f6b28165ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 --2- 172.21.15.118:0/2338671078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2814f6d0 0x7f6b28165760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 >> 172.21.15.118:0/2338671078 conn(0x7f6b28068100 msgr2=0x7f6b280c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 shutdown_connections 2023-09-28T00:22:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:34.884+0000 7f6b2cb4d700 1 -- 172.21.15.118:0/2338671078 wait complete. 2023-09-28T00:22:34.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 0f92e347-502d-4708-8e30-df844fed4ea7 3 2023-09-28T00:22:34.896 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:34.895+0000 7fe080df3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T00:22:34.974 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:34.974+0000 7fe080df3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T00:22:35.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.010+0000 7f2685107700 1 Processor -- start 2023-09-28T00:22:35.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.010+0000 7f2685107700 1 -- start start 2023-09-28T00:22:35.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f2685107700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26800c7f60 0x7f26801597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f2685107700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26800c6920 0x7f26800699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f2685107700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800c8ba0 con 0x7f26800c7b90 2023-09-28T00:22:35.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f2685107700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800c8990 con 0x7f26800c7f60 2023-09-28T00:22:35.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f2685107700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2680159d00 con 0x7f26800c6920 2023-09-28T00:22:35.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26800c6920 0x7f26800699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26800c6920 0x7f26800699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60508/0 (socket says 172.21.15.118:60508) 2023-09-28T00:22:35.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267ed9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f26800c7b90 0x7f268014f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:43036/0 (socket says 172.21.15.118:43036) 2023-09-28T00:22:35.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 -- 172.21.15.118:0/2362538132 learned_addr learned my addr 172.21.15.118:0/2362538132 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267e59c700 1 --2- 172.21.15.118:0/2362538132 >> v2:172.21.15.53:3300/0 conn(0x7f26800c7f60 0x7f26801597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 -- 172.21.15.118:0/2362538132 >> v2:172.21.15.53:3300/0 conn(0x7f26800c7f60 msgr2=0x7f26801597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:35.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 --2- 172.21.15.118:0/2362538132 >> v2:172.21.15.53:3300/0 conn(0x7f26800c7f60 0x7f26801597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 -- 172.21.15.118:0/2362538132 >> v1:172.21.15.118:6789/0 conn(0x7f26800c7b90 legacy=0x7f268014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 -- 172.21.15.118:0/2362538132 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800c8e80 con 0x7f26800c6920 2023-09-28T00:22:35.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267dd9b700 1 -- 172.21.15.118:0/2362538132 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27748770 0 0) 0x7f26800c8ba0 con 0x7f26800c7b90 2023-09-28T00:22:35.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267f59e700 1 --2- 172.21.15.118:0/2362538132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800699a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26800b1ec0 tx=0x7f2678009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d962b7ef5aac2934 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.011+0000 7f267dd9b700 1 -- 172.21.15.118:0/2362538132 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267800e070 con 0x7f26800c6920 2023-09-28T00:22:35.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f267dd9b700 1 -- 172.21.15.118:0/2362538132 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267800bae0 con 0x7f26800c6920 2023-09-28T00:22:35.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f267dd9b700 1 -- 172.21.15.118:0/2362538132 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26780092e0 con 0x7f26800c6920 2023-09-28T00:22:35.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 -- 172.21.15.118:0/2362538132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 msgr2=0x7f26800699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 --2- 172.21.15.118:0/2362538132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800699a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26800b1ec0 tx=0x7f2678009840 comp rx=0 tx=0).stop 2023-09-28T00:22:35.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 -- 172.21.15.118:0/2362538132 shutdown_connections 2023-09-28T00:22:35.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 --2- 172.21.15.118:0/2362538132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800699a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 --2- 172.21.15.118:0/2362538132 >> v2:172.21.15.53:3300/0 conn(0x7f26800c7f60 0x7f26801597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 -- 172.21.15.118:0/2362538132 >> 172.21.15.118:0/2362538132 conn(0x7f268006ed60 msgr2=0x7f268006f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 -- 172.21.15.118:0/2362538132 shutdown_connections 2023-09-28T00:22:35.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.012+0000 7f2685107700 1 -- 172.21.15.118:0/2362538132 wait complete. 2023-09-28T00:22:35.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 Processor -- start 2023-09-28T00:22:35.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 -- start start 2023-09-28T00:22:35.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 0x7f268014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26800c7f60 0x7f268014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c4060 con 0x7f26800c7f60 2023-09-28T00:22:35.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680146550 con 0x7f26800c6920 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f2685107700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c4b20 con 0x7f26800c7b90 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f267e59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 0x7f268014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f267e59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 0x7f268014bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53286/0 (socket says 172.21.15.118:53286) 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f267e59c700 1 -- 172.21.15.118:0/2348986566 learned_addr learned my addr 172.21.15.118:0/2348986566 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f267ed9d700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.014+0000 7f267f59e700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26800c7f60 0x7f268014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f267e59c700 1 -- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 msgr2=0x7f26800b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f267e59c700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f267e59c700 1 -- 172.21.15.118:0/2348986566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26800c7f60 msgr2=0x7f268014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f267e59c700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26800c7f60 0x7f268014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f267e59c700 1 -- 172.21.15.118:0/2348986566 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678009ae0 con 0x7f26800c7b90 2023-09-28T00:22:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f267e59c700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 0x7f268014bed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f267000d890 tx=0x7f2670008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700125f0 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670012750 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26800c5f70 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670012b10 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.015+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26800c4250 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.016+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f267001e6e0 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.016+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f2670014480 con 0x7f26800c7b90 2023-09-28T00:22:35.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.016+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2680071830 con 0x7f26800c7b90 2023-09-28T00:22:35.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.018+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f267001e990 con 0x7f26800c7b90 2023-09-28T00:22:35.095 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:35.094+0000 7f19f7648180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T00:22:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.101+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f92e347-502d-4708-8e30-df844fed4ea7", "id": 3} v 0) v1 -- 0x7f26800c9160 con 0x7f26800c7b90 2023-09-28T00:22:35.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.105+0000 7f2666ffd700 1 -- 172.21.15.118:0/2348986566 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f92e347-502d-4708-8e30-df844fed4ea7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f267001eb50 con 0x7f26800c7b90 2023-09-28T00:22:35.106 INFO:teuthology.orchestra.run.smithi118.stdout:3 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 msgr2=0x7f268014bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 0x7f268014bed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f267000d890 tx=0x7f2670008040 comp rx=0 tx=0).stop 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 shutdown_connections 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26800c7f60 0x7f268014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26800c6920 0x7f26800b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 --2- 172.21.15.118:0/2348986566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26800c7b90 0x7f268014bed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 >> 172.21.15.118:0/2348986566 conn(0x7f268006ed60 msgr2=0x7f2680157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 shutdown_connections 2023-09-28T00:22:35.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.106+0000 7f2685107700 1 -- 172.21.15.118:0/2348986566 wait complete. 2023-09-28T00:22:35.117 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new aabca63d-493c-4018-8c57-91a281625f16 4 2023-09-28T00:22:35.163 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:35.163+0000 7fe080df3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:22:35.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.230+0000 7f9bcbcb3700 1 Processor -- start 2023-09-28T00:22:35.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.230+0000 7f9bcbcb3700 1 -- start start 2023-09-28T00:22:35.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bcbcb3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc406c990 0x7f9bc40c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bcbcb3700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bc406a980 0x7f9bc4068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bcbcb3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40c9b60 con 0x7f9bc40c9360 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bcbcb3700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc4068390 con 0x7f9bc406a980 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bcbcb3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40c03e0 con 0x7f9bc406c990 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc9a4f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc406c990 0x7f9bc40c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc924e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9bc40c9360 0x7f9bc41527d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:43048/0 (socket says 172.21.15.118:43048) 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc924e700 1 -- 172.21.15.118:0/3267698065 learned_addr learned my addr 172.21.15.118:0/3267698065 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bca250700 1 --2- 172.21.15.118:0/3267698065 >> v2:172.21.15.53:3300/0 conn(0x7f9bc406a980 0x7f9bc4068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc9a4f700 1 -- 172.21.15.118:0/3267698065 >> v2:172.21.15.53:3300/0 conn(0x7f9bc406a980 msgr2=0x7f9bc4068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc9a4f700 1 --2- 172.21.15.118:0/3267698065 >> v2:172.21.15.53:3300/0 conn(0x7f9bc406a980 0x7f9bc4068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc8a4d700 1 -- 172.21.15.118:0/3267698065 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415220381 0 0) 0x7f9bc40c9b60 con 0x7f9bc40c9360 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc9a4f700 1 -- 172.21.15.118:0/3267698065 >> v1:172.21.15.118:6789/0 conn(0x7f9bc40c9360 legacy=0x7f9bc41527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc9a4f700 1 -- 172.21.15.118:0/3267698065 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4067aa0 con 0x7f9bc406c990 2023-09-28T00:22:35.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc9a4f700 1 --2- 172.21.15.118:0/3267698065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc406c990 0x7f9bc40c35c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00098e0 tx=0x7f9bc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae330240750c0d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc8a4d700 1 -- 172.21.15.118:0/3267698065 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0009e80 con 0x7f9bc406c990 2023-09-28T00:22:35.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc8a4d700 1 -- 172.21.15.118:0/3267698065 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc000b860 con 0x7f9bc406c990 2023-09-28T00:22:35.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.231+0000 7f9bc8a4d700 1 -- 172.21.15.118:0/3267698065 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc000bbe0 con 0x7f9bc406c990 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/3267698065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc406c990 msgr2=0x7f9bc40c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/3267698065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc406c990 0x7f9bc40c35c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00098e0 tx=0x7f9bc00091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/3267698065 shutdown_connections 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/3267698065 >> v2:172.21.15.53:3300/0 conn(0x7f9bc406a980 0x7f9bc4068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/3267698065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc406c990 0x7f9bc40c35c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/3267698065 >> 172.21.15.118:0/3267698065 conn(0x7f9bc406f780 msgr2=0x7f9bc40c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/3267698065 shutdown_connections 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.232+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/3267698065 wait complete. 2023-09-28T00:22:35.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.233+0000 7f9bcbcb3700 1 Processor -- start 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.233+0000 7f9bcbcb3700 1 -- start start 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 0x7f9bc4148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc406c990 0x7f9bc4168810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc40c9360 0x7f9bc4168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc414e4a0 con 0x7f9bc406c990 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc414d4d0 con 0x7f9bc406a980 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc41696c0 con 0x7f9bc40c9360 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bc9a4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 0x7f9bc4148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc40c9360 0x7f9bc4168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bc9a4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 0x7f9bc4148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60520/0 (socket says 172.21.15.118:60520) 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bc9a4f700 1 -- 172.21.15.118:0/2042631420 learned_addr learned my addr 172.21.15.118:0/2042631420 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bc924e700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc406c990 0x7f9bc4168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 -- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 msgr2=0x7f9bc4148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 0x7f9bc4148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 -- 172.21.15.118:0/2042631420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc406c990 msgr2=0x7f9bc4168810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc406c990 0x7f9bc4168810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 -- 172.21.15.118:0/2042631420 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc0009420 con 0x7f9bc40c9360 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bc924e700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc406c990 0x7f9bc4168810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bc9a4f700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 0x7f9bc4148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:35.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bca250700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc40c9360 0x7f9bc4168d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc007ed0 tx=0x7f9bbc009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc018070 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00ec40 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc414e1c0 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.234+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc014420 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.235+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9bbc003020 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.235+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc414bf70 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.235+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f9bbc014c70 con 0x7f9bc40c9360 2023-09-28T00:22:35.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.235+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc4071830 con 0x7f9bc40c9360 2023-09-28T00:22:35.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.238+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f9bbc014e30 con 0x7f9bc40c9360 2023-09-28T00:22:35.267 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:35.267+0000 7f19f7648180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T00:22:35.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.319+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aabca63d-493c-4018-8c57-91a281625f16", "id": 4} v 0) v1 -- 0x7f9bc40c9880 con 0x7f9bc40c9360 2023-09-28T00:22:35.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.323+0000 7f9bb9ffb700 1 -- 172.21.15.118:0/2042631420 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aabca63d-493c-4018-8c57-91a281625f16", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bbc01d500 con 0x7f9bc40c9360 2023-09-28T00:22:35.323 INFO:teuthology.orchestra.run.smithi118.stdout:4 2023-09-28T00:22:35.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc40c9360 msgr2=0x7f9bc4168d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc40c9360 0x7f9bc4168d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc007ed0 tx=0x7f9bbc009850 comp rx=0 tx=0).stop 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 shutdown_connections 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bc40c9360 0x7f9bc4168d50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bc406a980 0x7f9bc4148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 --2- 172.21.15.118:0/2042631420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc406c990 0x7f9bc4168810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 >> 172.21.15.118:0/2042631420 conn(0x7f9bc406f780 msgr2=0x7f9bc40c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 shutdown_connections 2023-09-28T00:22:35.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.324+0000 7f9bcbcb3700 1 -- 172.21.15.118:0/2042631420 wait complete. 2023-09-28T00:22:35.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 19a05f38-04e6-4cf2-a931-2deb179a4165 5 2023-09-28T00:22:35.339 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:35.339+0000 7fe080df3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T00:22:35.367 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:35.366+0000 7f19f7648180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T00:22:35.419 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:35.419+0000 7fe080df3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T00:22:35.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.450+0000 7ff471916700 1 Processor -- start 2023-09-28T00:22:35.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.450+0000 7ff471916700 1 -- start start 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff471916700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c7b90 0x7ff46c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff471916700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 0x7ff46c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff471916700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0c8ba0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff471916700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0c8990 con 0x7ff46c0c7b90 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff471916700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c159d00 con 0x7ff46c0c6920 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 0x7ff46c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 0x7ff46c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53304/0 (socket says 172.21.15.118:53304) 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 -- 172.21.15.118:0/3368275254 learned_addr learned my addr 172.21.15.118:0/3368275254 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46affd700 1 --2- 172.21.15.118:0/3368275254 >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c7b90 0x7ff46c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 -- 172.21.15.118:0/3368275254 >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c7b90 msgr2=0x7ff46c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 --2- 172.21.15.118:0/3368275254 >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c7b90 0x7ff46c1597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 -- 172.21.15.118:0/3368275254 >> v1:172.21.15.53:6789/0 conn(0x7ff46c0c7f60 legacy=0x7ff46c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 -- 172.21.15.118:0/3368275254 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0c8e80 con 0x7ff46c0c6920 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.451+0000 7ff46b7fe700 1 --2- 172.21.15.118:0/3368275254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 0x7ff46c0699a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff464009f20 tx=0x7ff464009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dfcebc997c6f3fe server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff469ffb700 1 -- 172.21.15.118:0/3368275254 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400e070 con 0x7ff46c0c6920 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff469ffb700 1 -- 172.21.15.118:0/3368275254 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400bad0 con 0x7ff46c0c6920 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff469ffb700 1 -- 172.21.15.118:0/3368275254 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640092e0 con 0x7ff46c0c6920 2023-09-28T00:22:35.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 -- 172.21.15.118:0/3368275254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 msgr2=0x7ff46c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 --2- 172.21.15.118:0/3368275254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 0x7ff46c0699a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff464009f20 tx=0x7ff464009840 comp rx=0 tx=0).stop 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 -- 172.21.15.118:0/3368275254 shutdown_connections 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 --2- 172.21.15.118:0/3368275254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c6920 0x7ff46c0699a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 --2- 172.21.15.118:0/3368275254 >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c7b90 0x7ff46c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 -- 172.21.15.118:0/3368275254 >> 172.21.15.118:0/3368275254 conn(0x7ff46c06ed60 msgr2=0x7ff46c06f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 -- 172.21.15.118:0/3368275254 shutdown_connections 2023-09-28T00:22:35.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.452+0000 7ff471916700 1 -- 172.21.15.118:0/3368275254 wait complete. 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 Processor -- start 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 -- start start 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c6920 0x7ff46c0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 0x7ff46c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 0x7ff46c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1668f0 con 0x7ff46c0c6920 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0c38f0 con 0x7ff46c0c7b90 2023-09-28T00:22:35.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff471916700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0ca580 con 0x7ff46c0c7f60 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 0x7ff46c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff46a7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 0x7ff46c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 0x7ff46c0b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53310/0 (socket says 172.21.15.118:53310) 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff46b7fe700 1 -- 172.21.15.118:0/538997191 learned_addr learned my addr 172.21.15.118:0/538997191 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.454+0000 7ff46a7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 0x7ff46c14cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60534/0 (socket says 172.21.15.118:60534) 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46affd700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c6920 0x7ff46c0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46b7fe700 1 -- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 msgr2=0x7ff46c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46b7fe700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 0x7ff46c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46b7fe700 1 -- 172.21.15.118:0/538997191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c6920 msgr2=0x7ff46c0c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46b7fe700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c6920 0x7ff46c0c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46b7fe700 1 -- 172.21.15.118:0/538997191 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464009ae0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46a7fc700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 0x7ff46c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff46b7fe700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 0x7ff46c0b0ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff46400b6c0 tx=0x7ff464017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640032f0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464012d30 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464012ea0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c14e090 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.455+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c166610 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.456+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff46401d8c0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.456+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7ff464025970 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.456+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c071830 con 0x7ff46c0c7f60 2023-09-28T00:22:35.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.458+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7ff4640446b0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.542+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "19a05f38-04e6-4cf2-a931-2deb179a4165", "id": 5} v 0) v1 -- 0x7ff46c0ca6c0 con 0x7ff46c0c7f60 2023-09-28T00:22:35.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.546+0000 7ff452ffd700 1 -- 172.21.15.118:0/538997191 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19a05f38-04e6-4cf2-a931-2deb179a4165", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff464033070 con 0x7ff46c0c7f60 2023-09-28T00:22:35.546 INFO:teuthology.orchestra.run.smithi118.stdout:5 2023-09-28T00:22:35.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 msgr2=0x7ff46c0b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 0x7ff46c0b0ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff46400b6c0 tx=0x7ff464017000 comp rx=0 tx=0).stop 2023-09-28T00:22:35.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 shutdown_connections 2023-09-28T00:22:35.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c0c7f60 0x7ff46c0b0ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c6920 0x7ff46c0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 --2- 172.21.15.118:0/538997191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0c7b90 0x7ff46c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 >> 172.21.15.118:0/538997191 conn(0x7ff46c06ed60 msgr2=0x7ff46c14ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 shutdown_connections 2023-09-28T00:22:35.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.547+0000 7ff471916700 1 -- 172.21.15.118:0/538997191 wait complete. 2023-09-28T00:22:35.558 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new fc48de62-15c9-469e-8485-8db16d31f052 6 2023-09-28T00:22:35.562 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:35.563+0000 7fe080df3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T00:22:35.602 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:35.602+0000 7f19f7648180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:22:35.660 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:35.660+0000 7fe080df3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T00:22:35.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.676+0000 7f33571da700 1 Processor -- start 2023-09-28T00:22:35.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.676+0000 7f33571da700 1 -- start start 2023-09-28T00:22:35.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33571da700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f335014f560 0x7f33500c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33571da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f33500c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33571da700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500c2720 con 0x7f33500c2bb0 2023-09-28T00:22:35.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33571da700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500c8620 con 0x7f335014f560 2023-09-28T00:22:35.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33571da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500c6c60 con 0x7f335014f930 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f33500c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33569d9700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f33500c2bb0 0x7f3350155440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:43074/0 (socket says 172.21.15.118:43074) 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33569d9700 1 -- 172.21.15.118:0/2234976751 learned_addr learned my addr 172.21.15.118:0/2234976751 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f33500c0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53312/0 (socket says 172.21.15.118:53312) 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33561d8700 1 --2- 172.21.15.118:0/2234976751 >> v2:172.21.15.53:3300/0 conn(0x7f335014f560 0x7f33500c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 -- 172.21.15.118:0/2234976751 >> v2:172.21.15.53:3300/0 conn(0x7f335014f560 msgr2=0x7f33500c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 --2- 172.21.15.118:0/2234976751 >> v2:172.21.15.53:3300/0 conn(0x7f335014f560 0x7f33500c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 -- 172.21.15.118:0/2234976751 >> v1:172.21.15.118:6789/0 conn(0x7f33500c2bb0 legacy=0x7f3350155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33551d6700 1 -- 172.21.15.118:0/2234976751 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425158494 0 0) 0x7f33500c2720 con 0x7f33500c2bb0 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 -- 172.21.15.118:0/2234976751 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500c1090 con 0x7f335014f930 2023-09-28T00:22:35.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33559d7700 1 --2- 172.21.15.118:0/2234976751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f33500c0b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f334c0098e0 tx=0x7f334c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5331d7ea8de890d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33551d6700 1 -- 172.21.15.118:0/2234976751 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c009e80 con 0x7f335014f930 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33551d6700 1 -- 172.21.15.118:0/2234976751 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00b8f0 con 0x7f335014f930 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.677+0000 7f33551d6700 1 -- 172.21.15.118:0/2234976751 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00bc70 con 0x7f335014f930 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 -- 172.21.15.118:0/2234976751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 msgr2=0x7f33500c0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 --2- 172.21.15.118:0/2234976751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f33500c0b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f334c0098e0 tx=0x7f334c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 -- 172.21.15.118:0/2234976751 shutdown_connections 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 --2- 172.21.15.118:0/2234976751 >> v2:172.21.15.53:3300/0 conn(0x7f335014f560 0x7f33500c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 --2- 172.21.15.118:0/2234976751 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f33500c0b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 -- 172.21.15.118:0/2234976751 >> 172.21.15.118:0/2234976751 conn(0x7f33500cbdb0 msgr2=0x7f33500cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 -- 172.21.15.118:0/2234976751 shutdown_connections 2023-09-28T00:22:35.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.678+0000 7f33571da700 1 -- 172.21.15.118:0/2234976751 wait complete. 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.679+0000 7f33571da700 1 Processor -- start 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.679+0000 7f33571da700 1 -- start start 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33571da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 0x7f3350165800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33571da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335014f560 0x7f3350144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33571da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f3350159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33571da700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350140c30 con 0x7f335014f560 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33571da700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350165370 con 0x7f33500c2bb0 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33571da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3350158ee0 con 0x7f335014f930 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 0x7f3350165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33569d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f3350159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 0x7f3350165800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:60544/0 (socket says 172.21.15.118:60544) 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 -- 172.21.15.118:0/3754931628 learned_addr learned my addr 172.21.15.118:0/3754931628 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33559d7700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335014f560 0x7f3350144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 -- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 msgr2=0x7f3350159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f3350159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 -- 172.21.15.118:0/3754931628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335014f560 msgr2=0x7f3350144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335014f560 0x7f3350144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 -- 172.21.15.118:0/3754931628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c009420 con 0x7f33500c2bb0 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33569d9700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f3350159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.680+0000 7f33561d8700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 0x7f3350165800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f334000d890 tx=0x7f3340008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400125f0 con 0x7f33500c2bb0 2023-09-28T00:22:35.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340012750 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340012af0 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3350140e80 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3350141440 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f334001e460 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.681+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f3340014a30 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.682+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335004c3c0 con 0x7f33500c2bb0 2023-09-28T00:22:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.684+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f3340012e60 con 0x7f33500c2bb0 2023-09-28T00:22:35.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.775+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc48de62-15c9-469e-8485-8db16d31f052", "id": 6} v 0) v1 -- 0x7f3350068e20 con 0x7f33500c2bb0 2023-09-28T00:22:35.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.779+0000 7f33467fc700 1 -- 172.21.15.118:0/3754931628 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc48de62-15c9-469e-8485-8db16d31f052", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f334002d0b0 con 0x7f33500c2bb0 2023-09-28T00:22:35.779 INFO:teuthology.orchestra.run.smithi118.stdout:6 2023-09-28T00:22:35.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 msgr2=0x7f3350165800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 0x7f3350165800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f334000d890 tx=0x7f3340008040 comp rx=0 tx=0).stop 2023-09-28T00:22:35.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 shutdown_connections 2023-09-28T00:22:35.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f335014f930 0x7f3350159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33500c2bb0 0x7f3350165800 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 --2- 172.21.15.118:0/3754931628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f335014f560 0x7f3350144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 >> 172.21.15.118:0/3754931628 conn(0x7f33500cbdb0 msgr2=0x7f335015ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 shutdown_connections 2023-09-28T00:22:35.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.780+0000 7f33571da700 1 -- 172.21.15.118:0/3754931628 wait complete. 2023-09-28T00:22:35.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new fc853be2-5788-4be1-a4b6-57b7113dc5fa 7 2023-09-28T00:22:35.825 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:35.824+0000 7f19f7648180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T00:22:35.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.902+0000 7fe4affff700 1 Processor -- start 2023-09-28T00:22:35.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.902+0000 7fe4affff700 1 -- start start 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4affff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4affff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4b0153f10 0x7fe4b014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4affff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b0153a80 con 0x7fe4b0069220 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4affff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b0067d00 con 0x7fe4b0153f10 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4affff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b00bf910 con 0x7fe4b0068e50 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4aeffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4af7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe4b0069220 0x7fe4b00c54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:43086/0 (socket says 172.21.15.118:43086) 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4af7fe700 1 -- 172.21.15.118:0/3396991450 learned_addr learned my addr 172.21.15.118:0/3396991450 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4a7fff700 1 --2- 172.21.15.118:0/3396991450 >> v2:172.21.15.53:3300/0 conn(0x7fe4b0153f10 0x7fe4b014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4ae7fc700 1 -- 172.21.15.118:0/3396991450 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602995225 0 0) 0x7fe4b0153a80 con 0x7fe4b0069220 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4aeffd700 1 -- 172.21.15.118:0/3396991450 >> v2:172.21.15.53:3300/0 conn(0x7fe4b0153f10 msgr2=0x7fe4b014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4aeffd700 1 --2- 172.21.15.118:0/3396991450 >> v2:172.21.15.53:3300/0 conn(0x7fe4b0153f10 0x7fe4b014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4aeffd700 1 -- 172.21.15.118:0/3396991450 >> v1:172.21.15.118:6789/0 conn(0x7fe4b0069220 legacy=0x7fe4b00c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4aeffd700 1 -- 172.21.15.118:0/3396991450 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0153450 con 0x7fe4b0068e50 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4aeffd700 1 --2- 172.21.15.118:0/3396991450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0156800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098e0 tx=0x7fe4a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3d5b2d5967107c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4ae7fc700 1 -- 172.21.15.118:0/3396991450 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0009e80 con 0x7fe4b0068e50 2023-09-28T00:22:35.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4ae7fc700 1 -- 172.21.15.118:0/3396991450 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000b860 con 0x7fe4b0068e50 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.903+0000 7fe4ae7fc700 1 -- 172.21.15.118:0/3396991450 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000bbe0 con 0x7fe4b0068e50 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 -- 172.21.15.118:0/3396991450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 msgr2=0x7fe4b0156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 --2- 172.21.15.118:0/3396991450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0156800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098e0 tx=0x7fe4a00091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 -- 172.21.15.118:0/3396991450 shutdown_connections 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 --2- 172.21.15.118:0/3396991450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0156800 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 --2- 172.21.15.118:0/3396991450 >> v2:172.21.15.53:3300/0 conn(0x7fe4b0153f10 0x7fe4b014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 -- 172.21.15.118:0/3396991450 >> 172.21.15.118:0/3396991450 conn(0x7fe4b006c7f0 msgr2=0x7fe4b006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 -- 172.21.15.118:0/3396991450 shutdown_connections 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.904+0000 7fe4affff700 1 -- 172.21.15.118:0/3396991450 wait complete. 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.905+0000 7fe4affff700 1 Processor -- start 2023-09-28T00:22:35.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.905+0000 7fe4affff700 1 -- start start 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b0069220 0x7fe4b00c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b0153f10 0x7fe4b0145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b01655d0 con 0x7fe4b0153f10 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b01566e0 con 0x7fe4b0069220 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b01664e0 con 0x7fe4b0068e50 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b0069220 0x7fe4b00c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0165fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:53330/0 (socket says 172.21.15.118:53330) 2023-09-28T00:22:35.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 -- 172.21.15.118:0/8072910 learned_addr learned my addr 172.21.15.118:0/8072910 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4af7fe700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b0153f10 0x7fe4b0145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 -- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b0069220 msgr2=0x7fe4b00c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b0069220 0x7fe4b00c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 -- 172.21.15.118:0/8072910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b0153f10 msgr2=0x7fe4b0145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b0153f10 0x7fe4b0145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 -- 172.21.15.118:0/8072910 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0009420 con 0x7fe4b0068e50 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4af7fe700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b0153f10 0x7fe4b0145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4aeffd700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0165fa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000b3c0 tx=0x7fe4a0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a001f070 con 0x7fe4b0068e50 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0000c90 con 0x7fe4b0068e50 2023-09-28T00:22:35.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0025420 con 0x7fe4b0068e50 2023-09-28T00:22:35.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.906+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b01657e0 con 0x7fe4b0068e50 2023-09-28T00:22:35.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.907+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b0156120 con 0x7fe4b0068e50 2023-09-28T00:22:35.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.907+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe4a0023070 con 0x7fe4b0068e50 2023-09-28T00:22:35.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.907+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fe4a002fab0 con 0x7fe4b0068e50 2023-09-28T00:22:35.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.907+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b004c3c0 con 0x7fe4b0068e50 2023-09-28T00:22:35.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.909+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fe4a002a070 con 0x7fe4b0068e50 2023-09-28T00:22:35.924 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:35.924+0000 7f19f7648180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T00:22:35.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.990+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc853be2-5788-4be1-a4b6-57b7113dc5fa", "id": 7} v 0) v1 -- 0x7fe4b014cf20 con 0x7fe4b0068e50 2023-09-28T00:22:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.994+0000 7fe4a6ffd700 1 -- 172.21.15.118:0/8072910 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc853be2-5788-4be1-a4b6-57b7113dc5fa", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4a0015020 con 0x7fe4b0068e50 2023-09-28T00:22:35.994 INFO:teuthology.orchestra.run.smithi118.stdout:7 2023-09-28T00:22:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 msgr2=0x7fe4b0165fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0165fa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000b3c0 tx=0x7fe4a0017000 comp rx=0 tx=0).stop 2023-09-28T00:22:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 shutdown_connections 2023-09-28T00:22:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4b0068e50 0x7fe4b0165fa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4b0153f10 0x7fe4b0145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 --2- 172.21.15.118:0/8072910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4b0069220 0x7fe4b00c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 >> 172.21.15.118:0/8072910 conn(0x7fe4b006c7f0 msgr2=0x7fe4b014c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 shutdown_connections 2023-09-28T00:22:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T00:22:35.995+0000 7fe4affff700 1 -- 172.21.15.118:0/8072910 wait complete. 2023-09-28T00:22:36.007 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-28T00:22:36.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-28T00:22:36.011 INFO:tasks.ceph.osd.0:Started 2023-09-28T00:22:36.012 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-28T00:22:36.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-28T00:22:36.016 INFO:tasks.ceph.osd.1:Started 2023-09-28T00:22:36.016 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-28T00:22:36.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-28T00:22:36.021 INFO:tasks.ceph.osd.2:Started 2023-09-28T00:22:36.022 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-28T00:22:36.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-28T00:22:36.027 INFO:tasks.ceph.osd.3:Started 2023-09-28T00:22:36.027 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-28T00:22:36.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-28T00:22:36.029 INFO:tasks.ceph.osd.4:Started 2023-09-28T00:22:36.029 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-28T00:22:36.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-28T00:22:36.031 INFO:tasks.ceph.osd.5:Started 2023-09-28T00:22:36.031 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-28T00:22:36.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-28T00:22:36.033 INFO:tasks.ceph.osd.6:Started 2023-09-28T00:22:36.033 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-28T00:22:36.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-28T00:22:36.035 INFO:tasks.ceph.osd.7:Started 2023-09-28T00:22:36.036 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:36.124 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:36.124+0000 7f19f7648180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T00:22:36.233 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:36.233+0000 7fe080df3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T00:22:36.279 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:36.278+0000 7f19f7648180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T00:22:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.280+0000 7f7c3259d700 1 Processor -- start 2023-09-28T00:22:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.280+0000 7f7c3259d700 1 -- start start 2023-09-28T00:22:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c3259d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c0cc560 0x7f7c2c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c3259d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0ccaa0 con 0x7f7c2c0add50 2023-09-28T00:22:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c3259d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0ae830 con 0x7f7c2c069ca0 2023-09-28T00:22:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c3259d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c068c00 con 0x7f7c2c0cc560 2023-09-28T00:22:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c3159b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c2c0add50 0x7f7c2c0ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53258/0 (socket says 172.21.15.53:53258) 2023-09-28T00:22:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c3159b700 1 -- 172.21.15.53:0/3262958338 learned_addr learned my addr 172.21.15.53:0/3262958338 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:36.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.281+0000 7f7c30d9a700 1 --2- 172.21.15.53:0/3262958338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c0cc560 0x7f7c2c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c30d9a700 1 -- 172.21.15.53:0/3262958338 >> v1:172.21.15.118:6789/0 conn(0x7f7c2c069ca0 legacy=0x7f7c2c14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c30d9a700 1 -- 172.21.15.53:0/3262958338 >> v1:172.21.15.53:6789/0 conn(0x7f7c2c0add50 legacy=0x7f7c2c0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c23fff700 1 -- 172.21.15.53:0/3262958338 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116278234 0 0) 0x7f7c2c0ae830 con 0x7f7c2c069ca0 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c30d9a700 1 -- 172.21.15.53:0/3262958338 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c068ee0 con 0x7f7c2c0cc560 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c30d9a700 1 --2- 172.21.15.53:0/3262958338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c0cc560 0x7f7c2c1560f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009910 tx=0x7f7c1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a88fcc624f3b649 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c23fff700 1 -- 172.21.15.53:0/3262958338 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00b760 con 0x7f7c2c0cc560 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c23fff700 1 -- 172.21.15.53:0/3262958338 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00b8c0 con 0x7f7c2c0cc560 2023-09-28T00:22:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.282+0000 7f7c23fff700 1 -- 172.21.15.53:0/3262958338 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00bc60 con 0x7f7c2c0cc560 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 -- 172.21.15.53:0/3262958338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c0cc560 msgr2=0x7f7c2c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 --2- 172.21.15.53:0/3262958338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c0cc560 0x7f7c2c1560f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009910 tx=0x7f7c1c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 -- 172.21.15.53:0/3262958338 shutdown_connections 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 --2- 172.21.15.53:0/3262958338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c0cc560 0x7f7c2c1560f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 -- 172.21.15.53:0/3262958338 >> 172.21.15.53:0/3262958338 conn(0x7f7c2c06f7f0 msgr2=0x7f7c2c0cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 -- 172.21.15.53:0/3262958338 shutdown_connections 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.283+0000 7f7c3259d700 1 -- 172.21.15.53:0/3262958338 wait complete. 2023-09-28T00:22:36.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.284+0000 7f7c3259d700 1 Processor -- start 2023-09-28T00:22:36.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.284+0000 7f7c3259d700 1 -- start start 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.285+0000 7f7c3259d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 0x7f7c2c0c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.285+0000 7f7c3259d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c0add50 0x7f7c2c0c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.285+0000 7f7c3259d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c2c0cc560 0x7f7c2c0b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.285+0000 7f7c3259d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0c16f0 con 0x7f7c2c0add50 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.285+0000 7f7c3259d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0bfdb0 con 0x7f7c2c0cc560 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.285+0000 7f7c3259d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0c0050 con 0x7f7c2c069ca0 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 0x7f7c2c0c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:36.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 0x7f7c2c0c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:52756/0 (socket says 172.21.15.53:52756) 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 -- 172.21.15.53:0/9068561 learned_addr learned my addr 172.21.15.53:0/9068561 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c31d9c700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c2c0cc560 0x7f7c2c0b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c30d9a700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c0add50 0x7f7c2c0c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 -- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c2c0cc560 msgr2=0x7f7c2c0b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c2c0cc560 0x7f7c2c0b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 -- 172.21.15.53:0/9068561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c0add50 msgr2=0x7f7c2c0c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c0add50 0x7f7c2c0c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 -- 172.21.15.53:0/9068561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009420 con 0x7f7c2c069ca0 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c3159b700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 0x7f7c2c0c04e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c760 tx=0x7f7c28007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.286+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28005b30 con 0x7f7c2c069ca0 2023-09-28T00:22:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.287+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28005cb0 con 0x7f7c2c069ca0 2023-09-28T00:22:36.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.287+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c159a50 con 0x7f7c2c069ca0 2023-09-28T00:22:36.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.287+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28007320 con 0x7f7c2c069ca0 2023-09-28T00:22:36.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.287+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c0c2810 con 0x7f7c2c069ca0 2023-09-28T00:22:36.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.287+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7c2801c6c0 con 0x7f7c2c069ca0 2023-09-28T00:22:36.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.287+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7c28005e20 con 0x7f7c2c069ca0 2023-09-28T00:22:36.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.288+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c04c3c0 con 0x7f7c2c069ca0 2023-09-28T00:22:36.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.290+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f7c28017070 con 0x7f7c2c069ca0 2023-09-28T00:22:36.308 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:36.309+0000 7fe080df3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T00:22:36.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.363+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c2c0691c0 con 0x7f7c2c069ca0 2023-09-28T00:22:36.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.364+0000 7f7c217fa700 1 -- 172.21.15.53:0/9068561 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f7c2801c970 con 0x7f7c2c069ca0 2023-09-28T00:22:36.365 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:36.365 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:35.992136+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:22:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 msgr2=0x7f7c2c0c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 0x7f7c2c0c04e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c760 tx=0x7f7c28007ef0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 shutdown_connections 2023-09-28T00:22:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7c2c069ca0 0x7f7c2c0c04e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c2c0cc560 0x7f7c2c0b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 --2- 172.21.15.53:0/9068561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c0add50 0x7f7c2c0c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:36.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 >> 172.21.15.53:0/9068561 conn(0x7f7c2c06f7f0 msgr2=0x7f7c2c0ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:36.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 shutdown_connections 2023-09-28T00:22:36.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:36.365+0000 7f7c3259d700 1 -- 172.21.15.53:0/9068561 wait complete. 2023-09-28T00:22:36.379 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-09-28T00:22:36.380+0000 7f74e18c8540 -1 Falling back to public interface 2023-09-28T00:22:36.383 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-28T00:22:36.383 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-28T00:22:36.388 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:36.388+0000 7fe080df3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T00:22:36.631 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-09-28T00:22:36.631+0000 7f37e7a73540 -1 Falling back to public interface 2023-09-28T00:22:36.647 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-09-28T00:22:36.647+0000 7f76c4bfd540 -1 Falling back to public interface 2023-09-28T00:22:36.650 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-09-28T00:22:36.650+0000 7efe2ff3a540 -1 Falling back to public interface 2023-09-28T00:22:36.708 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-09-28T00:22:36.707+0000 7f6195bfe540 -1 Falling back to public interface 2023-09-28T00:22:36.709 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-09-28T00:22:36.707+0000 7f6962a70540 -1 Falling back to public interface 2023-09-28T00:22:36.709 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-09-28T00:22:36.707+0000 7f6959dfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-09-28T00:22:36.709 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-09-28T00:22:36.707+0000 7f6959dfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-09-28T00:22:36.731 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-09-28T00:22:36.731+0000 7f23935c4540 -1 Falling back to public interface 2023-09-28T00:22:36.750 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-09-28T00:22:36.749+0000 7fe51ca06540 -1 Falling back to public interface 2023-09-28T00:22:36.889 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:36.888+0000 7f19f7648180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T00:22:36.962 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:36.962+0000 7fe080df3180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T00:22:36.988 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:36.988+0000 7f19f7648180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T00:22:37.088 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:37.088+0000 7f19f7648180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T00:22:37.095 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:37.095+0000 7fe080df3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:22:37.189 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:37.209 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:37.209+0000 7fe080df3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T00:22:37.355 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.354+0000 7f5d4ab9d700 1 Processor -- start 2023-09-28T00:22:37.356 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.355+0000 7f5d4ab9d700 1 -- start start 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4ab9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d990 0x7f5d440c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4ab9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5d440c1ae0 0x7f5d440c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4ab9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d440c4dd0 con 0x7f5d4414d5c0 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4ab9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d440c0c60 con 0x7f5d440c1ae0 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4ab9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44157c50 con 0x7f5d4414d990 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4939a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d990 0x7f5d440c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d4a39c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5d440c1ae0 0x7f5d440c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d49b9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5d4414d5c0 0x7f5d44153760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:55238/0 (socket says 172.21.15.53:55238) 2023-09-28T00:22:37.358 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.356+0000 7f5d49b9b700 1 -- 172.21.15.53:0/3344182361 learned_addr learned my addr 172.21.15.53:0/3344182361 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d4a39c700 1 -- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d990 msgr2=0x7f5d440c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d4a39c700 1 --2- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d990 0x7f5d440c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d4a39c700 1 -- 172.21.15.53:0/3344182361 >> v1:172.21.15.118:6789/0 conn(0x7f5d4414d5c0 legacy=0x7f5d44153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d4a39c700 1 -- 172.21.15.53:0/3344182361 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440c4af0 con 0x7f5d440c1ae0 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d4939a700 1 --2- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d990 0x7f5d440c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d48b99700 1 -- 172.21.15.53:0/3344182361 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954687396 0 0) 0x7f5d440c4dd0 con 0x7f5d4414d5c0 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d4a39c700 1 --2- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d440c23d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009e90 tx=0x7f5d3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ece318c0af5a9c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d48b99700 1 -- 172.21.15.53:0/3344182361 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00e070 con 0x7f5d440c1ae0 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d48b99700 1 -- 172.21.15.53:0/3344182361 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c00bbf0 con 0x7f5d440c1ae0 2023-09-28T00:22:37.359 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.357+0000 7f5d48b99700 1 -- 172.21.15.53:0/3344182361 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c012430 con 0x7f5d440c1ae0 2023-09-28T00:22:37.360 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 msgr2=0x7f5d440c23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:37.360 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d440c23d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009e90 tx=0x7f5d3c009780 comp rx=0 tx=0).stop 2023-09-28T00:22:37.360 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/3344182361 shutdown_connections 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d440c23d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/3344182361 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d990 0x7f5d440c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/3344182361 >> 172.21.15.53:0/3344182361 conn(0x7f5d4406ca50 msgr2=0x7f5d4406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/3344182361 shutdown_connections 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.358+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/3344182361 wait complete. 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.359+0000 7f5d4ab9d700 1 Processor -- start 2023-09-28T00:22:37.361 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.359+0000 7f5d4ab9d700 1 -- start start 2023-09-28T00:22:37.363 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4ab9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d44165a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:37.363 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4ab9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d5c0 0x7f5d4414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:37.363 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4ab9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d4406bb10 0x7f5d440c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:37.363 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4ab9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44165fa0 con 0x7f5d4406bb10 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4ab9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4406a5e0 con 0x7f5d440c1ae0 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4ab9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4406ae80 con 0x7f5d4414d5c0 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d49b9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d44165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.360+0000 7f5d4939a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d5c0 0x7f5d4414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d49b9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d44165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:35904/0 (socket says 172.21.15.53:35904) 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d49b9b700 1 -- 172.21.15.53:0/60713846 learned_addr learned my addr 172.21.15.53:0/60713846 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4a39c700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d4406bb10 0x7f5d440c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4939a700 1 -- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 msgr2=0x7f5d44165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4939a700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d44165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4939a700 1 -- 172.21.15.53:0/60713846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d4406bb10 msgr2=0x7f5d440c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4939a700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d4406bb10 0x7f5d440c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.364 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4939a700 1 -- 172.21.15.53:0/60713846 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009420 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d49b9b700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d44165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4939a700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d5c0 0x7f5d4414f0c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400ea30 tx=0x7f5d340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400ee70 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3400c8e0 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400cc80 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.361+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c009a20 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.362+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4414ba20 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.362+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5d34005c80 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.362+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5d34013680 con 0x7f5d4414d5c0 2023-09-28T00:22:37.365 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.363+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d44063230 con 0x7f5d4414d5c0 2023-09-28T00:22:37.366 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.365+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f5d34021060 con 0x7f5d4414d5c0 2023-09-28T00:22:37.439 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.438+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d4404bb80 con 0x7f5d4414d5c0 2023-09-28T00:22:37.439 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.439+0000 7f5d39ffb700 1 -- 172.21.15.53:0/60713846 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5d34029020 con 0x7f5d4414d5c0 2023-09-28T00:22:37.439 INFO:teuthology.misc.health.smithi053.stdout: 2023-09-28T00:22:37.440 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":10,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:35.992136+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d5c0 msgr2=0x7f5d4414f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d5c0 0x7f5d4414f0c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400ea30 tx=0x7f5d340091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 shutdown_connections 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d4406bb10 0x7f5d440c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d440c1ae0 0x7f5d44165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 --2- 172.21.15.53:0/60713846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d4414d5c0 0x7f5d4414f0c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 >> 172.21.15.53:0/60713846 conn(0x7f5d4406ca50 msgr2=0x7f5d440bf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 shutdown_connections 2023-09-28T00:22:37.441 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:37.440+0000 7f5d4ab9d700 1 -- 172.21.15.53:0/60713846 wait complete. 2023-09-28T00:22:37.452 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:37.453+0000 7fe080df3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T00:22:37.454 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-28T00:22:37.529 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:37.529+0000 7fe080df3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T00:22:37.826 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:37.825+0000 7f19f7648180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T00:22:38.003 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:38.002+0000 7f19f7648180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:22:38.129 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:38.129+0000 7f19f7648180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T00:22:38.351 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.351+0000 7fe080df3180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T00:22:38.424 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.422+0000 7fe080df3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T00:22:38.440 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:38.433+0000 7f19f7648180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T00:22:38.494 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.495+0000 7fe080df3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T00:22:38.534 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:38.533+0000 7f19f7648180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T00:22:38.627 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.627+0000 7fe080df3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T00:22:38.709 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.708+0000 7fe080df3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T00:22:38.857 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.857+0000 7fe080df3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T00:22:38.932 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:38.932+0000 7fe080df3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T00:22:39.004 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:39.004+0000 7fe080df3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T00:22:39.076 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:39.076+0000 7fe080df3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T00:22:39.583 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:39.582+0000 7f19f7648180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T00:22:39.698 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:39.697+0000 7f19f7648180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T00:22:39.805 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:39.805+0000 7f19f7648180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T00:22:39.924 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-09-28T00:22:39.924+0000 7f74e18c8540 -1 osd.4 0 log_to_monitors true 2023-09-28T00:22:39.975 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:39.974+0000 7f19f7648180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T00:22:40.085 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:40.085+0000 7f19f7648180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T00:22:40.102 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:40.102+0000 7fe03a1f7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-28T00:22:40.102 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-09-28T00:22:40.103+0000 7fe03a1f7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-28T00:22:40.146 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-09-28T00:22:40.146+0000 7f37e7a73540 -1 osd.6 0 log_to_monitors true 2023-09-28T00:22:40.174 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-09-28T00:22:40.174+0000 7f76c4bfd540 -1 osd.7 0 log_to_monitors true 2023-09-28T00:22:40.215 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-09-28T00:22:40.216+0000 7efe2ff3a540 -1 osd.5 0 log_to_monitors true 2023-09-28T00:22:40.293 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-09-28T00:22:40.292+0000 7f6195bfe540 -1 osd.0 0 log_to_monitors true 2023-09-28T00:22:40.302 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:40.302+0000 7f19f7648180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T00:22:40.317 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-09-28T00:22:40.316+0000 7f23935c4540 -1 osd.3 0 log_to_monitors true 2023-09-28T00:22:40.404 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:40.403+0000 7f19f7648180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T00:22:40.507 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:40.506+0000 7f19f7648180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T00:22:40.534 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-09-28T00:22:40.534+0000 7f6962a70540 -1 osd.1 0 log_to_monitors true 2023-09-28T00:22:40.578 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-09-28T00:22:40.577+0000 7fe51ca06540 -1 osd.2 0 log_to_monitors true 2023-09-28T00:22:40.615 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-09-28T00:22:40.614+0000 7f19f7648180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T00:22:42.684 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-09-28T00:22:42.684+0000 7f37de695700 -1 osd.6 0 waiting for initial osdmap 2023-09-28T00:22:42.689 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-09-28T00:22:42.688+0000 7f2386ff6700 -1 osd.3 0 waiting for initial osdmap 2023-09-28T00:22:42.692 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-09-28T00:22:42.692+0000 7f37d748c700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:42.699 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-09-28T00:22:42.699+0000 7f237ffe8700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:42.721 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-09-28T00:22:42.721+0000 7efe26b5c700 -1 osd.5 0 waiting for initial osdmap 2023-09-28T00:22:42.727 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-09-28T00:22:42.727+0000 7efe1f953700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:42.737 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-09-28T00:22:42.737+0000 7f74d9ced700 -1 osd.4 0 waiting for initial osdmap 2023-09-28T00:22:42.741 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-09-28T00:22:42.741+0000 7f74d12e1700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:42.764 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-09-28T00:22:42.764+0000 7f76bb81f700 -1 osd.7 0 waiting for initial osdmap 2023-09-28T00:22:42.767 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-09-28T00:22:42.767+0000 7f76b4616700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:42.869 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-09-28T00:22:42.868+0000 7f61895f6700 -1 osd.0 0 waiting for initial osdmap 2023-09-28T00:22:42.878 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-09-28T00:22:42.877+0000 7f61825e8700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:43.800 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-09-28T00:22:43.799+0000 7fe5103f6700 -1 osd.2 0 waiting for initial osdmap 2023-09-28T00:22:43.806 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-09-28T00:22:43.806+0000 7fe5093e8700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:43.833 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-09-28T00:22:43.832+0000 7f6957df9700 -1 osd.1 0 waiting for initial osdmap 2023-09-28T00:22:43.838 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-09-28T00:22:43.838+0000 7f694f5e8700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:22:44.259 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:44.423 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.422+0000 7fe606b9d700 1 Processor -- start 2023-09-28T00:22:44.423 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.422+0000 7fe606b9d700 1 -- start start 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe606b9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe60014f500 0x7fe6001556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe606b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe600156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe606b9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60006ef70 con 0x7fe6000c0f00 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe606b9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000c2c80 con 0x7fe60014f500 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe606b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000c9a10 con 0x7fe60014f8d0 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe605b9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe60014f500 0x7fe6001556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:44.426 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe60639c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe6000c0f00 0x7fe6000c1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53264/0 (socket says 172.21.15.53:53264) 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe60639c700 1 -- 172.21.15.53:0/4139346225 learned_addr learned my addr 172.21.15.53:0/4139346225 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.423+0000 7fe60539a700 1 --2- 172.21.15.53:0/4139346225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe600156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe605b9b700 1 -- 172.21.15.53:0/4139346225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 msgr2=0x7fe600156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe605b9b700 1 --2- 172.21.15.53:0/4139346225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe600156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe605b9b700 1 -- 172.21.15.53:0/4139346225 >> v1:172.21.15.53:6789/0 conn(0x7fe6000c0f00 legacy=0x7fe6000c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe605b9b700 1 -- 172.21.15.53:0/4139346225 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60006e0a0 con 0x7fe60014f500 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe604b99700 1 -- 172.21.15.53:0/4139346225 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958200522 0 0) 0x7fe60006ef70 con 0x7fe6000c0f00 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe605b9b700 1 --2- 172.21.15.53:0/4139346225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe6001556f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0098e0 tx=0x7fe5fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c95f8e381b7c1d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe604b99700 1 -- 172.21.15.53:0/4139346225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00b6d0 con 0x7fe60014f500 2023-09-28T00:22:44.427 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe604b99700 1 -- 172.21.15.53:0/4139346225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00b830 con 0x7fe60014f500 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.424+0000 7fe604b99700 1 -- 172.21.15.53:0/4139346225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00bbd0 con 0x7fe60014f500 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 -- 172.21.15.53:0/4139346225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 msgr2=0x7fe6001556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 --2- 172.21.15.53:0/4139346225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe6001556f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0098e0 tx=0x7fe5fc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 -- 172.21.15.53:0/4139346225 shutdown_connections 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 --2- 172.21.15.53:0/4139346225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe6001556f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 --2- 172.21.15.53:0/4139346225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe600156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 -- 172.21.15.53:0/4139346225 >> 172.21.15.53:0/4139346225 conn(0x7fe600070540 msgr2=0x7fe600070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 -- 172.21.15.53:0/4139346225 shutdown_connections 2023-09-28T00:22:44.428 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.425+0000 7fe606b9d700 1 -- 172.21.15.53:0/4139346225 wait complete. 2023-09-28T00:22:44.430 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.426+0000 7fe606b9d700 1 Processor -- start 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 -- start start 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6000c0f00 0x7fe600147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe600148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe6000cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000ca280 con 0x7fe60014f500 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000cb250 con 0x7fe6000c0f00 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.427+0000 7fe606b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000c82e0 con 0x7fe60014f8d0 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe600148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe600148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49930/0 (socket says 172.21.15.53:49930) 2023-09-28T00:22:44.431 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 -- 172.21.15.53:0/3760466219 learned_addr learned my addr 172.21.15.53:0/3760466219 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe605b9b700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6000c0f00 0x7fe600147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60639c700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe6000cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 -- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 msgr2=0x7fe6000cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe6000cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 -- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6000c0f00 msgr2=0x7fe600147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6000c0f00 0x7fe600147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 -- 172.21.15.53:0/3760466219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc009420 con 0x7fe60014f500 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe605b9b700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6000c0f00 0x7fe600147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60639c700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe6000cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.428+0000 7fe60539a700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe600148740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000e930 tx=0x7fe5f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:44.432 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.429+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0009510 con 0x7fe60014f500 2023-09-28T00:22:44.433 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.429+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000c850 con 0x7fe60014f500 2023-09-28T00:22:44.433 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.429+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000cc10 con 0x7fe60014f500 2023-09-28T00:22:44.433 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.429+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6000ca4b0 con 0x7fe60014f500 2023-09-28T00:22:44.433 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.429+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6000caee0 con 0x7fe60014f500 2023-09-28T00:22:44.433 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.430+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6000c2460 con 0x7fe60014f500 2023-09-28T00:22:44.434 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.431+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 84984+0+0 (secure 0 0 0) 0x7fe5f0013470 con 0x7fe60014f500 2023-09-28T00:22:44.434 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.431+0000 7fe5f5ffb700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe5e40672a0 0x7fe5e4069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:44.434 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.432+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3907+0+0 (secure 0 0 0) 0x7fe5f0084470 con 0x7fe60014f500 2023-09-28T00:22:44.434 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.432+0000 7fe605b9b700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe5e40672a0 0x7fe5e4069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:44.434 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.432+0000 7fe605b9b700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe5e40672a0 0x7fe5e4069750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0093f0 tx=0x7fe5fc017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:44.437 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.436+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe5f0051c10 con 0x7fe60014f500 2023-09-28T00:22:44.642 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.641+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6001538a0 con 0x7fe60014f500 2023-09-28T00:22:44.642 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.642+0000 7fe5f5ffb700 1 -- 172.21.15.53:0/3760466219 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9616 (secure 0 0 0) 0x7fe5f0055230 con 0x7fe60014f500 2023-09-28T00:22:44.643 INFO:teuthology.misc.health.smithi053.stdout: 2023-09-28T00:22:44.643 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":14,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:43.695284+0000","last_up_change":"2023-09-28T00:22:43.695284+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:22:44.645 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe5e40672a0 msgr2=0x7fe5e4069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe5e40672a0 0x7fe5e4069750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0093f0 tx=0x7fe5fc017000 comp rx=0 tx=0).stop 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 msgr2=0x7fe600148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe600148740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000e930 tx=0x7fe5f00091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 shutdown_connections 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe5e40672a0 0x7fe5e4069750 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60014f8d0 0x7fe6000cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6000c0f00 0x7fe600147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 --2- 172.21.15.53:0/3760466219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe60014f500 0x7fe600148740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 >> 172.21.15.53:0/3760466219 conn(0x7fe600070540 msgr2=0x7fe60014eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:44.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 shutdown_connections 2023-09-28T00:22:44.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:44.644+0000 7fe606b9d700 1 -- 172.21.15.53:0/3760466219 wait complete. 2023-09-28T00:22:44.660 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-09-28T00:22:51.467 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:51.639 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.639+0000 7f1b38b9d700 1 Processor -- start 2023-09-28T00:22:51.639 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.639+0000 7f1b38b9d700 1 -- start start 2023-09-28T00:22:51.640 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b38b9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b3414d5c0 0x7f1b340c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:51.640 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b38b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b340c1ae0 0x7f1b340c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:51.640 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b38b9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340c4dd0 con 0x7f1b3414d990 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b38b9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b340c0c60 con 0x7f1b3414d5c0 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b38b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34157c50 con 0x7f1b340c1ae0 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b337fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b3414d5c0 0x7f1b340c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.640+0000 7f1b32ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1b3414d990 0x7f1b34153760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34232/0 (socket says 172.21.15.53:34232) 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.641+0000 7f1b337fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b3414d5c0 0x7f1b340c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43184/0 (socket says 172.21.15.53:43184) 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.641+0000 7f1b32ffd700 1 -- 172.21.15.53:0/934443189 learned_addr learned my addr 172.21.15.53:0/934443189 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:51.641 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.641+0000 7f1b33fff700 1 --2- 172.21.15.53:0/934443189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b340c1ae0 0x7f1b340c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.641+0000 7f1b337fe700 1 -- 172.21.15.53:0/934443189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b340c1ae0 msgr2=0x7f1b340c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.641+0000 7f1b337fe700 1 --2- 172.21.15.53:0/934443189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b340c1ae0 0x7f1b340c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b337fe700 1 -- 172.21.15.53:0/934443189 >> v1:172.21.15.53:6789/0 conn(0x7f1b3414d990 legacy=0x7f1b34153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b337fe700 1 -- 172.21.15.53:0/934443189 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340c4af0 con 0x7f1b3414d5c0 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b327fc700 1 -- 172.21.15.53:0/934443189 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392513478 0 0) 0x7f1b340c4dd0 con 0x7f1b3414d990 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b337fe700 1 --2- 172.21.15.53:0/934443189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c4460 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009910 tx=0x7f1b240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241999ec892b2c31 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b327fc700 1 -- 172.21.15.53:0/934443189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400b640 con 0x7f1b3414d5c0 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b327fc700 1 -- 172.21.15.53:0/934443189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400b7a0 con 0x7f1b3414d5c0 2023-09-28T00:22:51.643 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.642+0000 7f1b327fc700 1 -- 172.21.15.53:0/934443189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400bb60 con 0x7f1b3414d5c0 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 -- 172.21.15.53:0/934443189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 msgr2=0x7f1b340c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/934443189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c4460 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009910 tx=0x7f1b240091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 -- 172.21.15.53:0/934443189 shutdown_connections 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/934443189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b340c1ae0 0x7f1b340c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/934443189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c4460 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 -- 172.21.15.53:0/934443189 >> 172.21.15.53:0/934443189 conn(0x7f1b3406ca50 msgr2=0x7f1b3406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 -- 172.21.15.53:0/934443189 shutdown_connections 2023-09-28T00:22:51.644 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.643+0000 7f1b38b9d700 1 -- 172.21.15.53:0/934443189 wait complete. 2023-09-28T00:22:51.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.644+0000 7f1b38b9d700 1 Processor -- start 2023-09-28T00:22:51.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.644+0000 7f1b38b9d700 1 -- start start 2023-09-28T00:22:51.646 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b38b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c1ae0 0x7f1b34143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b38b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b38b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b34141e70 0x7f1b34144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b38b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34145ac0 con 0x7f1b3414d5c0 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b38b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b341648e0 con 0x7f1b340c1ae0 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b38b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340c7420 con 0x7f1b34141e70 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.645+0000 7f1b32ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43186/0 (socket says 172.21.15.53:43186) 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 -- 172.21.15.53:0/256136224 learned_addr learned my addr 172.21.15.53:0/256136224 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:51.647 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b337fe700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c1ae0 0x7f1b34143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b33fff700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b34141e70 0x7f1b34144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 -- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b34141e70 msgr2=0x7f1b34144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b34141e70 0x7f1b34144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 -- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c1ae0 msgr2=0x7f1b34143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c1ae0 0x7f1b34143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 -- 172.21.15.53:0/256136224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009420 con 0x7f1b3414d5c0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b32ffd700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c6500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c5b0 tx=0x7f1b28001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28005c00 con 0x7f1b3414d5c0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28005d60 con 0x7f1b3414d5c0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.646+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28007300 con 0x7f1b3414d5c0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.647+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b340c76e0 con 0x7f1b3414d5c0 2023-09-28T00:22:51.648 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.647+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b34163e00 con 0x7f1b3414d5c0 2023-09-28T00:22:51.649 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.648+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b34063230 con 0x7f1b3414d5c0 2023-09-28T00:22:51.649 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.649+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1b2801b3b0 con 0x7f1b3414d5c0 2023-09-28T00:22:51.649 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.649+0000 7f1b1b7fe700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b20067360 0x7f1b20069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:51.650 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.650+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1b28083d20 con 0x7f1b3414d5c0 2023-09-28T00:22:51.650 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.650+0000 7f1b337fe700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b20067360 0x7f1b20069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:51.650 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.650+0000 7f1b337fe700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b20067360 0x7f1b20069810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009860 tx=0x7f1b24017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:51.654 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.654+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1b28051030 con 0x7f1b3414d5c0 2023-09-28T00:22:51.856 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.856+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b3404bb80 con 0x7f1b3414d5c0 2023-09-28T00:22:51.857 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.857+0000 7f1b1b7fe700 1 -- 172.21.15.53:0/256136224 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f1b28017090 con 0x7f1b3414d5c0 2023-09-28T00:22:51.857 INFO:teuthology.misc.health.smithi053.stdout: 2023-09-28T00:22:51.857 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":18,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:47.811277+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b20067360 msgr2=0x7f1b20069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b20067360 0x7f1b20069810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009860 tx=0x7f1b24017000 comp rx=0 tx=0).stop 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 msgr2=0x7f1b340c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c6500 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c5b0 tx=0x7f1b28001070 comp rx=0 tx=0).stop 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 shutdown_connections 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b20067360 0x7f1b20069810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b34141e70 0x7f1b34144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.859+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c1ae0 0x7f1b34143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.860 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.860+0000 7f1b38b9d700 1 --2- 172.21.15.53:0/256136224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3414d5c0 0x7f1b340c6500 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:51.861 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.860+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 >> 172.21.15.53:0/256136224 conn(0x7f1b3406ca50 msgr2=0x7f1b3414c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:51.861 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.860+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 shutdown_connections 2023-09-28T00:22:51.861 INFO:teuthology.misc.health.smithi053.stderr:2023-09-28T00:22:51.860+0000 7f1b38b9d700 1 -- 172.21.15.53:0/256136224 wait complete. 2023-09-28T00:22:51.874 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-28T00:22:51.874 INFO:tasks.ceph:Creating RBD pool 2023-09-28T00:22:51.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-28T00:22:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.054+0000 7f0253fff700 1 Processor -- start 2023-09-28T00:22:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.054+0000 7f0253fff700 1 -- start start 2023-09-28T00:22:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.055+0000 7f0253fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f025413ed20 0x7f0254159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.055+0000 7f0253fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0254156040 con 0x7f02540c11e0 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.055+0000 7f0253fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02540c6cf0 con 0x7f02540c0e10 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.055+0000 7f0253fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02540c6730 con 0x7f025413ed20 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.055+0000 7f02537fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f025413ed20 0x7f0254159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02537fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f025413ed20 0x7f0254159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43196/0 (socket says 172.21.15.53:43196) 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02537fe700 1 -- 172.21.15.53:0/1790187049 learned_addr learned my addr 172.21.15.53:0/1790187049 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02527fc700 1 --1- 172.21.15.53:0/1790187049 >> v1:172.21.15.53:6789/0 conn(0x7f02540c11e0 0x7f025415e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34246/0 (socket says 172.21.15.53:34246) 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f0251ffb700 1 -- 172.21.15.53:0/1790187049 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216951669 0 0) 0x7f02540c6cf0 con 0x7f02540c0e10 2023-09-28T00:22:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02537fe700 1 -- 172.21.15.53:0/1790187049 >> v1:172.21.15.118:6789/0 conn(0x7f02540c0e10 legacy=0x7f025413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02537fe700 1 -- 172.21.15.53:0/1790187049 >> v1:172.21.15.53:6789/0 conn(0x7f02540c11e0 legacy=0x7f025415e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02537fe700 1 -- 172.21.15.53:0/1790187049 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02540c6a10 con 0x7f025413ed20 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f02537fe700 1 --2- 172.21.15.53:0/1790187049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254159840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f024c009f20 tx=0x7f024c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c574745dab5d825 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f0251ffb700 1 -- 172.21.15.53:0/1790187049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00e070 con 0x7f025413ed20 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f0251ffb700 1 -- 172.21.15.53:0/1790187049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00ba80 con 0x7f025413ed20 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.056+0000 7f0251ffb700 1 -- 172.21.15.53:0/1790187049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0092e0 con 0x7f025413ed20 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 -- 172.21.15.53:0/1790187049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 msgr2=0x7f0254159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 --2- 172.21.15.53:0/1790187049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254159840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f024c009f20 tx=0x7f024c009840 comp rx=0 tx=0).stop 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 -- 172.21.15.53:0/1790187049 shutdown_connections 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 --2- 172.21.15.53:0/1790187049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254159840 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 -- 172.21.15.53:0/1790187049 >> 172.21.15.53:0/1790187049 conn(0x7f025406f830 msgr2=0x7f02540cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 -- 172.21.15.53:0/1790187049 shutdown_connections 2023-09-28T00:22:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.057+0000 7f0253fff700 1 -- 172.21.15.53:0/1790187049 wait complete. 2023-09-28T00:22:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.059+0000 7f0253fff700 1 Processor -- start 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.059+0000 7f0253fff700 1 -- start start 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0253fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02540c0e10 0x7f02541698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0253fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02540c11e0 0x7f0254153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0253fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0253fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254154a10 con 0x7f025413ed20 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0253fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254169df0 con 0x7f02540c11e0 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0253fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02540ae750 con 0x7f02540c0e10 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43200/0 (socket says 172.21.15.53:43200) 2023-09-28T00:22:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 -- 172.21.15.53:0/1465023587 learned_addr learned my addr 172.21.15.53:0/1465023587 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02527fc700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02540c11e0 0x7f0254153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f0252ffd700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02540c0e10 0x7f02541698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 -- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02540c0e10 msgr2=0x7f02541698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02540c0e10 0x7f02541698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 -- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02540c11e0 msgr2=0x7f0254153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02540c11e0 0x7f0254153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.060+0000 7f02537fe700 1 -- 172.21.15.53:0/1465023587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009ae0 con 0x7f025413ed20 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.061+0000 7f02537fe700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254158850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f024c012000 tx=0x7f024c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.061+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c007d10 con 0x7f025413ed20 2023-09-28T00:22:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.061+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c007e90 con 0x7f025413ed20 2023-09-28T00:22:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.061+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c01c660 con 0x7f025413ed20 2023-09-28T00:22:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.061+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0254165a70 con 0x7f025413ed20 2023-09-28T00:22:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.061+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02540ae4b0 con 0x7f025413ed20 2023-09-28T00:22:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.062+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540c97d0 con 0x7f025413ed20 2023-09-28T00:22:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.063+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f024c01c9d0 con 0x7f025413ed20 2023-09-28T00:22:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.065+0000 7f023affd700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0240067330 0x7f02400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.065+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f024c085f20 con 0x7f025413ed20 2023-09-28T00:22:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.065+0000 7f0252ffd700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0240067330 0x7f02400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.066+0000 7f0252ffd700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0240067330 0x7f02400697e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02440011e0 tx=0x7f0244007ce0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:52.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.069+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f024c053230 con 0x7f025413ed20 2023-09-28T00:22:52.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:52.273+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f025404c3f0 con 0x7f025413ed20 2023-09-28T00:22:53.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.161+0000 7f023affd700 1 -- 172.21.15.53:0/1465023587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f024c056850 con 0x7f025413ed20 2023-09-28T00:22:53.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0240067330 msgr2=0x7f02400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:53.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0240067330 0x7f02400697e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02440011e0 tx=0x7f0244007ce0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 msgr2=0x7f0254158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254158850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f024c012000 tx=0x7f024c018000 comp rx=0 tx=0).stop 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 shutdown_connections 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0240067330 0x7f02400697e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02540c0e10 0x7f02541698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f025413ed20 0x7f0254158850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 --2- 172.21.15.53:0/1465023587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02540c11e0 0x7f0254153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 >> 172.21.15.53:0/1465023587 conn(0x7f025406f830 msgr2=0x7f025413cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 shutdown_connections 2023-09-28T00:22:53.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.164+0000 7f0253fff700 1 -- 172.21.15.53:0/1465023587 wait complete. 2023-09-28T00:22:53.166 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2023-09-28T00:22:53.185 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-28T00:22:53.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.375+0000 7f5b2b59e700 1 Processor -- start 2023-09-28T00:22:53.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.375+0000 7f5b2b59e700 1 -- start start 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b2b59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b2c0c69a0 0x7f5b2c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b2b59e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b2c0c4750 0x7f5b2c0c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b2b59e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c069480 con 0x7f5b2c0c56c0 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b2b59e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c06cd10 con 0x7f5b2c0c4750 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b2b59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c06a580 con 0x7f5b2c0c69a0 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b2c0c4750 0x7f5b2c0c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b2c0c4750 0x7f5b2c0c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43216/0 (socket says 172.21.15.53:43216) 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 -- 172.21.15.53:0/88028618 learned_addr learned my addr 172.21.15.53:0/88028618 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:53.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b2a59c700 1 --2- 172.21.15.53:0/88028618 >> v2:172.21.15.118:3300/0 conn(0x7f5b2c0c69a0 0x7f5b2c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 -- 172.21.15.53:0/88028618 >> v2:172.21.15.118:3300/0 conn(0x7f5b2c0c69a0 msgr2=0x7f5b2c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 --2- 172.21.15.53:0/88028618 >> v2:172.21.15.118:3300/0 conn(0x7f5b2c0c69a0 0x7f5b2c06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 -- 172.21.15.53:0/88028618 >> v1:172.21.15.53:6789/0 conn(0x7f5b2c0c56c0 legacy=0x7f5b2c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.377+0000 7f5b29d9b700 1 -- 172.21.15.53:0/88028618 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c068870 con 0x7f5b2c0c4750 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.378+0000 7f5b29d9b700 1 --2- 172.21.15.53:0/88028618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c0c5180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06f3f0 tx=0x7f5b20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c53e0787d8048 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.378+0000 7f5b2959a700 1 -- 172.21.15.53:0/88028618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20009e70 con 0x7f5b2c0c4750 2023-09-28T00:22:53.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.378+0000 7f5b2959a700 1 -- 172.21.15.53:0/88028618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000b860 con 0x7f5b2c0c4750 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.378+0000 7f5b2959a700 1 -- 172.21.15.53:0/88028618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000bc00 con 0x7f5b2c0c4750 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.378+0000 7f5b2b59e700 1 -- 172.21.15.53:0/88028618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 msgr2=0x7f5b2c0c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.378+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/88028618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c0c5180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06f3f0 tx=0x7f5b20009250 comp rx=0 tx=0).stop 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.379+0000 7f5b2b59e700 1 -- 172.21.15.53:0/88028618 shutdown_connections 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.379+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/88028618 >> v2:172.21.15.118:3300/0 conn(0x7f5b2c0c69a0 0x7f5b2c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.379+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/88028618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c0c5180 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.379+0000 7f5b2b59e700 1 -- 172.21.15.53:0/88028618 >> 172.21.15.53:0/88028618 conn(0x7f5b2c067630 msgr2=0x7f5b2c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.379+0000 7f5b2b59e700 1 -- 172.21.15.53:0/88028618 shutdown_connections 2023-09-28T00:22:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.379+0000 7f5b2b59e700 1 -- 172.21.15.53:0/88028618 wait complete. 2023-09-28T00:22:53.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.380+0000 7f5b2b59e700 1 Processor -- start 2023-09-28T00:22:53.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.380+0000 7f5b2b59e700 1 -- start start 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2b59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c166320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b2c0c56c0 0x7f5b2c1638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b2c0c69a0 0x7f5b2c14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2b59e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c166860 con 0x7f5b2c0c4750 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0ca990 con 0x7f5b2c0c56c0 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c2a30 con 0x7f5b2c0c69a0 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c166320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c166320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43232/0 (socket says 172.21.15.53:43232) 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2a59c700 1 -- 172.21.15.53:0/1096651566 learned_addr learned my addr 172.21.15.53:0/1096651566 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b2ad9d700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b2c0c69a0 0x7f5b2c14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.381+0000 7f5b29d9b700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b2c0c56c0 0x7f5b2c1638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2a59c700 1 -- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b2c0c69a0 msgr2=0x7f5b2c14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2a59c700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b2c0c69a0 0x7f5b2c14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2a59c700 1 -- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b2c0c56c0 msgr2=0x7f5b2c1638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2a59c700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b2c0c56c0 0x7f5b2c1638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2a59c700 1 -- 172.21.15.53:0/1096651566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200094f0 con 0x7f5b2c0c4750 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2a59c700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c166320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e930 tx=0x7f5b1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c013680 con 0x7f5b2c0c4750 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0137e0 con 0x7f5b2c0c4750 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0ca6b0 con 0x7f5b2c0c4750 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.382+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c013b80 con 0x7f5b2c0c4750 2023-09-28T00:22:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.383+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c1584a0 con 0x7f5b2c0c4750 2023-09-28T00:22:53.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.383+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c06a950 con 0x7f5b2c0c4750 2023-09-28T00:22:53.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.384+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5b1c00c3e0 con 0x7f5b2c0c4750 2023-09-28T00:22:53.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.385+0000 7f5b1a7fc700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5b0c067330 0x7f5b0c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:53.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.385+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f5b1c084980 con 0x7f5b2c0c4750 2023-09-28T00:22:53.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.386+0000 7f5b29d9b700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5b0c067330 0x7f5b0c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:53.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.386+0000 7f5b29d9b700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5b0c067330 0x7f5b0c0697e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06f3f0 tx=0x7f5b20017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.390+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5b1c051b40 con 0x7f5b2c0c4750 2023-09-28T00:22:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:53.595+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5b2c071830 con 0x7f5b2c0c4750 2023-09-28T00:22:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.166+0000 7f5b1a7fc700 1 -- 172.21.15.53:0/1096651566 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5b1c055160 con 0x7f5b2c0c4750 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5b0c067330 msgr2=0x7f5b0c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5b0c067330 0x7f5b0c0697e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06f3f0 tx=0x7f5b20017000 comp rx=0 tx=0).stop 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 msgr2=0x7f5b2c166320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c166320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e930 tx=0x7f5b1c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 shutdown_connections 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5b0c067330 0x7f5b0c0697e0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06f3f0 tx=0x7f5b20017000 comp rx=0 tx=0).stop 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b2c0c69a0 0x7f5b2c14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c0c4750 0x7f5b2c166320 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e930 tx=0x7f5b1c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 --2- 172.21.15.53:0/1096651566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b2c0c56c0 0x7f5b2c1638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.169+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 >> 172.21.15.53:0/1096651566 conn(0x7f5b2c067630 msgr2=0x7f5b2c153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.171+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 shutdown_connections 2023-09-28T00:22:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.171+0000 7f5b2b59e700 1 -- 172.21.15.53:0/1096651566 wait complete. 2023-09-28T00:22:54.173 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-28T00:22:54.190 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-28T00:22:54.191 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-28T00:22:54.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-28T00:22:54.195 INFO:tasks.ceph.mds.a:Started 2023-09-28T00:22:54.195 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-28T00:22:54.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-28T00:22:54.199 INFO:tasks.ceph.mds.c:Started 2023-09-28T00:22:54.200 INFO:tasks.ceph.mds.e:Restarting daemon 2023-09-28T00:22:54.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-09-28T00:22:54.204 INFO:tasks.ceph.mds.e:Started 2023-09-28T00:22:54.204 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-28T00:22:54.204 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-28T00:22:54.207 INFO:tasks.ceph.mds.b:Started 2023-09-28T00:22:54.207 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-28T00:22:54.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-28T00:22:54.209 INFO:tasks.ceph.mds.d:Started 2023-09-28T00:22:54.210 INFO:tasks.ceph.mds.f:Restarting daemon 2023-09-28T00:22:54.210 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2023-09-28T00:22:54.211 INFO:tasks.ceph.mds.f:Started 2023-09-28T00:22:54.212 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-28T00:22:54.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:54.288 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-09-28T00:22:54.288 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-09-28T00:22:54.288 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-09-28T00:22:54.288+0000 7fa0a50b3700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-09-28T00:22:54.289 INFO:tasks.ceph.mds.f.smithi118.stdout:starting mds.f at 2023-09-28T00:22:54.343 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-09-28T00:22:54.349 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-09-28T00:22:54.350 INFO:tasks.ceph.mds.e.smithi053.stdout:starting mds.e at 2023-09-28T00:22:54.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.419+0000 7f6e3b19d700 1 Processor -- start 2023-09-28T00:22:54.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.419+0000 7f6e3b19d700 1 -- start start 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.420+0000 7f6e3b19d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e34068990 0x7f6e34068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3b19d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e3406cc60 0x7f6e341568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3b19d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e341557c0 con 0x7f6e340c71f0 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3b19d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3406c7d0 con 0x7f6e34068990 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3b19d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e340692a0 con 0x7f6e3406cc60 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e34068990 0x7f6e34068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e34068990 0x7f6e34068d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43278/0 (socket says 172.21.15.53:43278) 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 -- 172.21.15.53:0/2482363761 learned_addr learned my addr 172.21.15.53:0/2482363761 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:54.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3999a700 1 --2- 172.21.15.53:0/2482363761 >> v2:172.21.15.118:3300/0 conn(0x7f6e3406cc60 0x7f6e341568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 -- 172.21.15.53:0/2482363761 >> v2:172.21.15.118:3300/0 conn(0x7f6e3406cc60 msgr2=0x7f6e341568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 --2- 172.21.15.53:0/2482363761 >> v2:172.21.15.118:3300/0 conn(0x7f6e3406cc60 0x7f6e341568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 -- 172.21.15.53:0/2482363761 >> v1:172.21.15.118:6789/0 conn(0x7f6e340c71f0 legacy=0x7f6e340c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e39199700 1 -- 172.21.15.53:0/2482363761 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520894887 0 0) 0x7f6e341557c0 con 0x7f6e340c71f0 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.421+0000 7f6e3a19b700 1 -- 172.21.15.53:0/2482363761 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340635f0 con 0x7f6e34068990 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3a19b700 1 --2- 172.21.15.53:0/2482363761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e34068990 0x7f6e34068d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e300099b0 tx=0x7f6e30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae6f3a65571f50f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e39199700 1 -- 172.21.15.53:0/2482363761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30009ea0 con 0x7f6e34068990 2023-09-28T00:22:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e39199700 1 -- 172.21.15.53:0/2482363761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000b820 con 0x7f6e34068990 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e39199700 1 -- 172.21.15.53:0/2482363761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000bbc0 con 0x7f6e34068990 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3b19d700 1 -- 172.21.15.53:0/2482363761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e34068990 msgr2=0x7f6e34068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/2482363761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e34068990 0x7f6e34068d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e300099b0 tx=0x7f6e30009250 comp rx=0 tx=0).stop 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3b19d700 1 -- 172.21.15.53:0/2482363761 shutdown_connections 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/2482363761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e34068990 0x7f6e34068d60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/2482363761 >> v2:172.21.15.118:3300/0 conn(0x7f6e3406cc60 0x7f6e341568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.422+0000 7f6e3b19d700 1 -- 172.21.15.53:0/2482363761 >> 172.21.15.53:0/2482363761 conn(0x7f6e34067630 msgr2=0x7f6e34067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.423+0000 7f6e3b19d700 1 -- 172.21.15.53:0/2482363761 shutdown_connections 2023-09-28T00:22:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.423+0000 7f6e3b19d700 1 -- 172.21.15.53:0/2482363761 wait complete. 2023-09-28T00:22:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.424+0000 7f6e3b19d700 1 Processor -- start 2023-09-28T00:22:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.424+0000 7f6e3b19d700 1 -- start start 2023-09-28T00:22:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3b19d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 0x7f6e34164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3b19d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e3406cc60 0x7f6e340c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3b19d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c71f0 0x7f6e340c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3b19d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341659c0 con 0x7f6e3406cc60 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3b19d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34165140 con 0x7f6e34068990 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3b19d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34165400 con 0x7f6e340c71f0 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3a19b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 0x7f6e34164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3999a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e3406cc60 0x7f6e340c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3a99c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c71f0 0x7f6e340c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3999a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e3406cc60 0x7f6e340c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43288/0 (socket says 172.21.15.53:43288) 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3a19b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 0x7f6e34164ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:39856/0 (socket says 172.21.15.53:39856) 2023-09-28T00:22:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.425+0000 7f6e3999a700 1 -- 172.21.15.53:0/4036466611 learned_addr learned my addr 172.21.15.53:0/4036466611 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3a19b700 1 -- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c71f0 msgr2=0x7f6e340c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3a19b700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c71f0 0x7f6e340c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3a19b700 1 -- 172.21.15.53:0/4036466611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e3406cc60 msgr2=0x7f6e340c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3a19b700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e3406cc60 0x7f6e340c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3a19b700 1 -- 172.21.15.53:0/4036466611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300094f0 con 0x7f6e34068990 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3a19b700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 0x7f6e34164ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e3406c740 tx=0x7f6e30017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30000d10 con 0x7f6e34068990 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000bba0 con 0x7f6e34068990 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011650 con 0x7f6e34068990 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e341656e0 con 0x7f6e34068990 2023-09-28T00:22:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.426+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e340c5410 con 0x7f6e34068990 2023-09-28T00:22:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.427+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3404c3c0 con 0x7f6e34068990 2023-09-28T00:22:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.429+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6e30011a40 con 0x7f6e34068990 2023-09-28T00:22:54.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.431+0000 7f6e2a7fc700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6e18067330 0x7f6e180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.431+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6e30086100 con 0x7f6e34068990 2023-09-28T00:22:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.431+0000 7f6e3999a700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6e18067330 0x7f6e180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.432+0000 7f6e3999a700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6e18067330 0x7f6e180697e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e34069080 tx=0x7f6e240091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:54.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.435+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6e30053330 con 0x7f6e34068990 2023-09-28T00:22:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.641+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e3406bbc0 con 0x7f6e34068990 2023-09-28T00:22:54.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.643+0000 7f6e2a7fc700 1 -- 172.21.15.53:0/4036466611 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13708 (secure 0 0 0) 0x7f6e30056950 con 0x7f6e34068990 2023-09-28T00:22:54.643 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:54.643 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:54.159909+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6e18067330 msgr2=0x7f6e180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6e18067330 0x7f6e180697e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e34069080 tx=0x7f6e240091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 msgr2=0x7f6e34164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 0x7f6e34164ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e3406c740 tx=0x7f6e30017000 comp rx=0 tx=0).stop 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 shutdown_connections 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6e18067330 0x7f6e180697e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c71f0 0x7f6e340c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e34068990 0x7f6e34164ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 --2- 172.21.15.53:0/4036466611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e3406cc60 0x7f6e340c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 >> 172.21.15.53:0/4036466611 conn(0x7f6e34067630 msgr2=0x7f6e34159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:54.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 shutdown_connections 2023-09-28T00:22:54.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.645+0000 7f6e3b19d700 1 -- 172.21.15.53:0/4036466611 wait complete. 2023-09-28T00:22:54.662 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:22:45.151575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:22:52.312450+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-28T00:22:54.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:22:54.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.851+0000 7fdcc2f9d700 1 Processor -- start 2023-09-28T00:22:54.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.852+0000 7fdcc2f9d700 1 -- start start 2023-09-28T00:22:54.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc2f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc06c550 0x7fdcbc155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc2f9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdcbc155c90 0x7fdcbc15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc2f9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc06cab0 con 0x7fdcbc14f7c0 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc2f9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc0c5070 con 0x7fdcbc155c90 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc2f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc159970 con 0x7fdcbc06c550 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc1f9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdcbc14f7c0 0x7fdcbc06f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34308/0 (socket says 172.21.15.53:34308) 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc1f9b700 1 -- 172.21.15.53:0/409708336 learned_addr learned my addr 172.21.15.53:0/409708336 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc279c700 1 --2- 172.21.15.53:0/409708336 >> v2:172.21.15.53:3300/0 conn(0x7fdcbc155c90 0x7fdcbc15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.853+0000 7fdcc179a700 1 --2- 172.21.15.53:0/409708336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc06c550 0x7fdcbc155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc279c700 1 -- 172.21.15.53:0/409708336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc06c550 msgr2=0x7fdcbc155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc279c700 1 --2- 172.21.15.53:0/409708336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc06c550 0x7fdcbc155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc279c700 1 -- 172.21.15.53:0/409708336 >> v1:172.21.15.53:6789/0 conn(0x7fdcbc14f7c0 legacy=0x7fdcbc06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc279c700 1 -- 172.21.15.53:0/409708336 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc156110 con 0x7fdcbc155c90 2023-09-28T00:22:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc279c700 1 --2- 172.21.15.53:0/409708336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc15fff0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009e60 tx=0x7fdcb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fff2112adad5f80 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:54.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc0f99700 1 -- 172.21.15.53:0/409708336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400e070 con 0x7fdcbc155c90 2023-09-28T00:22:54.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc0f99700 1 -- 172.21.15.53:0/409708336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400bb60 con 0x7fdcbc155c90 2023-09-28T00:22:54.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.854+0000 7fdcc0f99700 1 -- 172.21.15.53:0/409708336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4012430 con 0x7fdcbc155c90 2023-09-28T00:22:54.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/409708336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 msgr2=0x7fdcbc15fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/409708336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc15fff0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009e60 tx=0x7fdcb4009780 comp rx=0 tx=0).stop 2023-09-28T00:22:54.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/409708336 shutdown_connections 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/409708336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc15fff0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/409708336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc06c550 0x7fdcbc155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/409708336 >> 172.21.15.53:0/409708336 conn(0x7fdcbc068740 msgr2=0x7fdcbc068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/409708336 shutdown_connections 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.855+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/409708336 wait complete. 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.856+0000 7fdcc2f9d700 1 Processor -- start 2023-09-28T00:22:54.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.857+0000 7fdcc2f9d700 1 -- start start 2023-09-28T00:22:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.857+0000 7fdcc2f9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcbc06c550 0x7fdcbc169060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.857+0000 7fdcc2f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc14f7c0 0x7fdcbc165ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.857+0000 7fdcc2f9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc2f9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc157940 con 0x7fdcbc155c90 2023-09-28T00:22:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc2f9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc165620 con 0x7fdcbc06c550 2023-09-28T00:22:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc2f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0c6960 con 0x7fdcbc14f7c0 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc06ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43312/0 (socket says 172.21.15.53:43312) 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 -- 172.21.15.53:0/3545058328 learned_addr learned my addr 172.21.15.53:0/3545058328 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc1f9b700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcbc06c550 0x7fdcbc169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc179a700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc14f7c0 0x7fdcbc165ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 -- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc14f7c0 msgr2=0x7fdcbc165ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc14f7c0 0x7fdcbc165ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 -- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcbc06c550 msgr2=0x7fdcbc169060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcbc06c550 0x7fdcbc169060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 -- 172.21.15.53:0/3545058328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009a20 con 0x7fdcbc155c90 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.858+0000 7fdcc279c700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc06ef50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400b6c0 tx=0x7fdcb4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.859+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4012e90 con 0x7fdcbc155c90 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.859+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4027470 con 0x7fdcbc155c90 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.859+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc158150 con 0x7fdcbc155c90 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.859+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4027850 con 0x7fdcbc155c90 2023-09-28T00:22:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.859+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc165ff0 con 0x7fdcbc155c90 2023-09-28T00:22:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.860+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc1657b0 con 0x7fdcbc155c90 2023-09-28T00:22:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.861+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdcb4024070 con 0x7fdcbc155c90 2023-09-28T00:22:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.862+0000 7fdcb1ffb700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fdca0067360 0x7fdca0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.862+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdcb40873b0 con 0x7fdcbc155c90 2023-09-28T00:22:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.862+0000 7fdcc1f9b700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fdca0067360 0x7fdca0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.863+0000 7fdcc1f9b700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fdca0067360 0x7fdca0069810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8007130 tx=0x7fdcb8007eb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:54.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:54.867+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdcb4054560 con 0x7fdcbc155c90 2023-09-28T00:22:55.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.066+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcbc06cce0 con 0x7fdcbc155c90 2023-09-28T00:22:55.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.067+0000 7fdcb1ffb700 1 -- 172.21.15.53:0/3545058328 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcb4057b80 con 0x7fdcbc155c90 2023-09-28T00:22:55.067 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-09-28T00:22:55.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fdca0067360 msgr2=0x7fdca0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fdca0067360 0x7fdca0069810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8007130 tx=0x7fdcb8007eb0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 msgr2=0x7fdcbc06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc06ef50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400b6c0 tx=0x7fdcb4019000 comp rx=0 tx=0).stop 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 shutdown_connections 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fdca0067360 0x7fdca0069810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcbc155c90 0x7fdcbc06ef50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcbc06c550 0x7fdcbc169060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 --2- 172.21.15.53:0/3545058328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcbc14f7c0 0x7fdcbc165ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.069+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 >> 172.21.15.53:0/3545058328 conn(0x7fdcbc068740 msgr2=0x7fdcbc0c2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.070+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 shutdown_connections 2023-09-28T00:22:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.070+0000 7fdcc2f9d700 1 -- 172.21.15.53:0/3545058328 wait complete. 2023-09-28T00:22:55.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:22:55.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.277+0000 7fad22b9d700 1 Processor -- start 2023-09-28T00:22:55.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.277+0000 7fad22b9d700 1 -- start start 2023-09-28T00:22:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.278+0000 7fad22b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.278+0000 7fad22b9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fad1c13ed20 0x7fad1c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.278+0000 7fad22b9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c156040 con 0x7fad1c0c11e0 2023-09-28T00:22:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.278+0000 7fad22b9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0c6cf0 con 0x7fad1c13ed20 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.278+0000 7fad22b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c6730 con 0x7fad1c0c0e10 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad21b9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2239c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fad1c13ed20 0x7fad1c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2139a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fad1c0c11e0 0x7fad1c13e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:57606/0 (socket says 172.21.15.53:57606) 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2139a700 1 -- 172.21.15.53:0/3034996526 learned_addr learned my addr 172.21.15.53:0/3034996526 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad20b99700 1 -- 172.21.15.53:0/3034996526 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351771523 0 0) 0x7fad1c156040 con 0x7fad1c0c11e0 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad20b99700 1 -- 172.21.15.53:0/3034996526 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad08003570 con 0x7fad1c0c11e0 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2239c700 1 -- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 msgr2=0x7fad1c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2239c700 1 --2- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2239c700 1 -- 172.21.15.53:0/3034996526 >> v1:172.21.15.118:6789/0 conn(0x7fad1c0c11e0 legacy=0x7fad1c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2239c700 1 -- 172.21.15.53:0/3034996526 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0c6a10 con 0x7fad1c13ed20 2023-09-28T00:22:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad21b9b700 1 --2- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad2239c700 1 --2- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0cc580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad14009e90 tx=0x7fad14009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3592b3f30e7e177e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.279+0000 7fad20b99700 1 -- 172.21.15.53:0/3034996526 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400e070 con 0x7fad1c13ed20 2023-09-28T00:22:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad20b99700 1 -- 172.21.15.53:0/3034996526 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400bb40 con 0x7fad1c13ed20 2023-09-28T00:22:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad20b99700 1 -- 172.21.15.53:0/3034996526 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14012430 con 0x7fad1c13ed20 2023-09-28T00:22:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 -- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 msgr2=0x7fad1c0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 --2- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0cc580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad14009e90 tx=0x7fad14009780 comp rx=0 tx=0).stop 2023-09-28T00:22:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 -- 172.21.15.53:0/3034996526 shutdown_connections 2023-09-28T00:22:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 --2- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0cc580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 --2- 172.21.15.53:0/3034996526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 -- 172.21.15.53:0/3034996526 >> 172.21.15.53:0/3034996526 conn(0x7fad1c06f830 msgr2=0x7fad1c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 -- 172.21.15.53:0/3034996526 shutdown_connections 2023-09-28T00:22:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.280+0000 7fad22b9d700 1 -- 172.21.15.53:0/3034996526 wait complete. 2023-09-28T00:22:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.282+0000 7fad22b9d700 1 Processor -- start 2023-09-28T00:22:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.282+0000 7fad22b9d700 1 -- start start 2023-09-28T00:22:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.282+0000 7fad22b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c1385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad22b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 0x7fad1c138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad22b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad22b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c138180 con 0x7fad1c0c11e0 2023-09-28T00:22:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad22b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0c7dd0 con 0x7fad1c13ed20 2023-09-28T00:22:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad22b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0cb1e0 con 0x7fad1c0c0e10 2023-09-28T00:22:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 0x7fad1c138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 0x7fad1c138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43318/0 (socket says 172.21.15.53:43318) 2023-09-28T00:22:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 -- 172.21.15.53:0/763225593 learned_addr learned my addr 172.21.15.53:0/763225593 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad21b9b700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c1385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2239c700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 -- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 msgr2=0x7fad1c1385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c1385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 -- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 msgr2=0x7fad1c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 -- 172.21.15.53:0/763225593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009420 con 0x7fad1c0c11e0 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.283+0000 7fad2139a700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 0x7fad1c138ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c7c0 tx=0x7fad0c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.284+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c005c00 con 0x7fad1c0c11e0 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.284+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c005d60 con 0x7fad1c0c11e0 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.284+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14009a20 con 0x7fad1c0c11e0 2023-09-28T00:22:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.284+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c007320 con 0x7fad1c0c11e0 2023-09-28T00:22:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.284+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c0cb720 con 0x7fad1c0c11e0 2023-09-28T00:22:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.285+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c04c3c0 con 0x7fad1c0c11e0 2023-09-28T00:22:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.286+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad0c007690 con 0x7fad1c0c11e0 2023-09-28T00:22:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.287+0000 7fad11ffb700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fad00067330 0x7fad000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.287+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fad0c083da0 con 0x7fad1c0c11e0 2023-09-28T00:22:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.287+0000 7fad21b9b700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fad00067330 0x7fad000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.288+0000 7fad21b9b700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fad00067330 0x7fad000697e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad18009f40 tx=0x7fad180091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.291+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad0c050f50 con 0x7fad1c0c11e0 2023-09-28T00:22:55.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.497+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad1c1559f0 con 0x7fad1c0c11e0 2023-09-28T00:22:55.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.498+0000 7fad11ffb700 1 -- 172.21.15.53:0/763225593 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad0c0170a0 con 0x7fad1c0c11e0 2023-09-28T00:22:55.498 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fad00067330 msgr2=0x7fad000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fad00067330 0x7fad000697e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad18009f40 tx=0x7fad180091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 msgr2=0x7fad1c138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 0x7fad1c138ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c7c0 tx=0x7fad0c007dd0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 shutdown_connections 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fad00067330 0x7fad000697e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad1c0c0e10 0x7fad1c1385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad1c13ed20 0x7fad1c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 --2- 172.21.15.53:0/763225593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad1c0c11e0 0x7fad1c138ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.500+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 >> 172.21.15.53:0/763225593 conn(0x7fad1c06f830 msgr2=0x7fad1c13daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.501+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 shutdown_connections 2023-09-28T00:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.501+0000 7fad22b9d700 1 -- 172.21.15.53:0/763225593 wait complete. 2023-09-28T00:22:55.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:22:55.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.703+0000 7f131c99d700 1 Processor -- start 2023-09-28T00:22:55.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.704+0000 7f131c99d700 1 -- start start 2023-09-28T00:22:55.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f131c99d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13180c71f0 0x7f13180c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f131c99d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13181557c0 con 0x7f1318068990 2023-09-28T00:22:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f131c99d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131806c7d0 con 0x7f131806cc60 2023-09-28T00:22:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f131c99d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180635f0 con 0x7f13180c71f0 2023-09-28T00:22:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f13177fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1318068990 0x7f1318068d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34312/0 (socket says 172.21.15.53:34312) 2023-09-28T00:22:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f13177fe700 1 -- 172.21.15.53:0/2790621450 learned_addr learned my addr 172.21.15.53:0/2790621450 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f1317fff700 1 --2- 172.21.15.53:0/2790621450 >> v2:172.21.15.118:3300/0 conn(0x7f13180c71f0 0x7f13180c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606586418 0 0) 0x7f13181557c0 con 0x7f1318068990 2023-09-28T00:22:55.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1304003570 con 0x7f1318068990 2023-09-28T00:22:55.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.705+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566301921 0 0) 0x7f131806c7d0 con 0x7f131806cc60 2023-09-28T00:22:55.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13181557c0 con 0x7f131806cc60 2023-09-28T00:22:55.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1317fff700 1 -- 172.21.15.53:0/2790621450 >> v1:172.21.15.118:6789/0 conn(0x7f131806cc60 legacy=0x7f13181568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1317fff700 1 -- 172.21.15.53:0/2790621450 >> v1:172.21.15.53:6789/0 conn(0x7f1318068990 legacy=0x7f1318068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1317fff700 1 -- 172.21.15.53:0/2790621450 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131806bbc0 con 0x7f13180c71f0 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1317fff700 1 --2- 172.21.15.53:0/2790621450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f13180c2fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1310009e90 tx=0x7f1310009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=692571f50e2503eb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000e070 con 0x7f13180c71f0 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131000bb90 con 0x7f13180c71f0 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.706+0000 7f1316ffd700 1 -- 172.21.15.53:0/2790621450 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310012430 con 0x7f13180c71f0 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 -- 172.21.15.53:0/2790621450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 msgr2=0x7f13180c2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 --2- 172.21.15.53:0/2790621450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f13180c2fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1310009e90 tx=0x7f1310009780 comp rx=0 tx=0).stop 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 -- 172.21.15.53:0/2790621450 shutdown_connections 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 --2- 172.21.15.53:0/2790621450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f13180c2fc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 -- 172.21.15.53:0/2790621450 >> 172.21.15.53:0/2790621450 conn(0x7f1318067630 msgr2=0x7f1318067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 -- 172.21.15.53:0/2790621450 shutdown_connections 2023-09-28T00:22:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.707+0000 7f131c99d700 1 -- 172.21.15.53:0/2790621450 wait complete. 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.708+0000 7f131c99d700 1 Processor -- start 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.708+0000 7f131c99d700 1 -- start start 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f131c99d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 0x7f1318151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f131c99d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131806cc60 0x7f13180c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f131c99d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f131815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f131c99d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318152eb0 con 0x7f1318068990 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f131c99d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318165360 con 0x7f13180c71f0 2023-09-28T00:22:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f131c99d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180c9e60 con 0x7f131806cc60 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.709+0000 7f13177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 0x7f1318151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 0x7f1318151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43328/0 (socket says 172.21.15.53:43328) 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 -- 172.21.15.53:0/3307043784 learned_addr learned my addr 172.21.15.53:0/3307043784 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f1317fff700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f131815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f130ffff700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131806cc60 0x7f13180c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 -- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131806cc60 msgr2=0x7f13180c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131806cc60 0x7f13180c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 -- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 msgr2=0x7f131815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f131815a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 -- 172.21.15.53:0/3307043784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310009a20 con 0x7f1318068990 2023-09-28T00:22:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f13177fe700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 0x7f1318151490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f130800c7c0 tx=0x7f1308007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308005b30 con 0x7f1318068990 2023-09-28T00:22:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308005c90 con 0x7f1318068990 2023-09-28T00:22:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308007300 con 0x7f1318068990 2023-09-28T00:22:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.710+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318165600 con 0x7f1318068990 2023-09-28T00:22:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.711+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13181528f0 con 0x7f1318068990 2023-09-28T00:22:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.712+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13180c9370 con 0x7f1318068990 2023-09-28T00:22:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.713+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f130801b3b0 con 0x7f1318068990 2023-09-28T00:22:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.713+0000 7f130f7fe700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f12f8067330 0x7f12f80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.713+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1308083df0 con 0x7f1318068990 2023-09-28T00:22:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.714+0000 7f130ffff700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f12f8067330 0x7f12f80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.714+0000 7f130ffff700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f12f8067330 0x7f12f80697e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f131815b880 tx=0x7f1300007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:55.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.718+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1308050fa0 con 0x7f1318068990 2023-09-28T00:22:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.963+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f131804c3c0 con 0x7f1318068990 2023-09-28T00:22:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.963+0000 7f130f7fe700 1 -- 172.21.15.53:0/3307043784 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5039 (secure 0 0 0) 0x7f1308017090 con 0x7f1318068990 2023-09-28T00:22:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:55.963 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4271,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-09-28T00:22:55.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f12f8067330 msgr2=0x7f12f80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f12f8067330 0x7f12f80697e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f131815b880 tx=0x7f1300007d50 comp rx=0 tx=0).stop 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 msgr2=0x7f1318151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 0x7f1318151490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f130800c7c0 tx=0x7f1308007ea0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 shutdown_connections 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f12f8067330 0x7f12f80697e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13180c71f0 0x7f131815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1318068990 0x7f1318151490 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 --2- 172.21.15.53:0/3307043784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131806cc60 0x7f13180c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:55.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 >> 172.21.15.53:0/3307043784 conn(0x7f1318067630 msgr2=0x7f131814ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:55.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 shutdown_connections 2023-09-28T00:22:55.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:55.966+0000 7f131c99d700 1 -- 172.21.15.53:0/3307043784 wait complete. 2023-09-28T00:22:55.968 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 3 2023-09-28T00:22:55.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:56.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.170+0000 7f5864b9d700 1 Processor -- start 2023-09-28T00:22:56.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.170+0000 7f5864b9d700 1 -- start start 2023-09-28T00:22:56.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.171+0000 7f5864b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f58601560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f5864b9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 0x7f58600ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f5864b9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5860069ca0 0x7f586006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f5864b9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600ccaa0 con 0x7f58600cc560 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f5864b9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5860068c00 con 0x7f5860069ca0 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f5864b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5860068ee0 con 0x7f58600add50 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f58601560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585effd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 0x7f58600ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f58601560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:40978/0 (socket says 172.21.15.53:40978) 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5860069ca0 0x7f586006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585effd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 0x7f58600ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36604/0 (socket says 172.21.15.53:36604) 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 -- 172.21.15.53:0/2881549239 learned_addr learned my addr 172.21.15.53:0/2881549239 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 -- 172.21.15.53:0/2881549239 >> v2:172.21.15.118:3300/0 conn(0x7f5860069ca0 msgr2=0x7f586006a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:56.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 --2- 172.21.15.53:0/2881549239 >> v2:172.21.15.118:3300/0 conn(0x7f5860069ca0 0x7f586006a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 -- 172.21.15.53:0/2881549239 >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 msgr2=0x7f58600ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:56.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 --2- 172.21.15.53:0/2881549239 >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 0x7f58600ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585f7fe700 1 -- 172.21.15.53:0/2881549239 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58600691c0 con 0x7f58600add50 2023-09-28T00:22:56.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.172+0000 7f585effd700 1 --2- 172.21.15.53:0/2881549239 >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 0x7f58600ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:56.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.173+0000 7f585f7fe700 1 --2- 172.21.15.53:0/2881549239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f58601560f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f586006a920 tx=0x7f5850009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db01c24234ed9fdc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:56.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.173+0000 7f585e7fc700 1 -- 172.21.15.53:0/2881549239 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000b6d0 con 0x7f58600add50 2023-09-28T00:22:56.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.173+0000 7f585e7fc700 1 -- 172.21.15.53:0/2881549239 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585000b830 con 0x7f58600add50 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.173+0000 7f585e7fc700 1 -- 172.21.15.53:0/2881549239 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000bbf0 con 0x7f58600add50 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 -- 172.21.15.53:0/2881549239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 msgr2=0x7f58601560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 --2- 172.21.15.53:0/2881549239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f58601560f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f586006a920 tx=0x7f5850009250 comp rx=0 tx=0).stop 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 -- 172.21.15.53:0/2881549239 shutdown_connections 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 --2- 172.21.15.53:0/2881549239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f58601560f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 --2- 172.21.15.53:0/2881549239 >> v2:172.21.15.118:3300/0 conn(0x7f5860069ca0 0x7f586006a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 --2- 172.21.15.53:0/2881549239 >> v2:172.21.15.53:3300/0 conn(0x7f58600cc560 0x7f58600ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 -- 172.21.15.53:0/2881549239 >> 172.21.15.53:0/2881549239 conn(0x7f586006f7f0 msgr2=0x7f58600cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:56.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 -- 172.21.15.53:0/2881549239 shutdown_connections 2023-09-28T00:22:56.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.174+0000 7f5864b9d700 1 -- 172.21.15.53:0/2881549239 wait complete. 2023-09-28T00:22:56.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.175+0000 7f5864b9d700 1 Processor -- start 2023-09-28T00:22:56.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.176+0000 7f5864b9d700 1 -- start start 2023-09-28T00:22:56.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.176+0000 7f5864b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5860069ca0 0x7f5860158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f5864b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f5860168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f5864b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600cc560 0x7f5860144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f5864b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58601529d0 con 0x7f58600cc560 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f5864b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58601699a0 con 0x7f5860069ca0 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f5864b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5860159660 con 0x7f58600add50 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600cc560 0x7f5860144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585effd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f5860168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5860069ca0 0x7f5860158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585effd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f5860168f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:40988/0 (socket says 172.21.15.53:40988) 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585effd700 1 -- 172.21.15.53:0/1812023649 learned_addr learned my addr 172.21.15.53:0/1812023649 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585ffff700 1 -- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 msgr2=0x7f5860168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585ffff700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f5860168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585ffff700 1 -- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5860069ca0 msgr2=0x7f5860158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585ffff700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5860069ca0 0x7f5860158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585ffff700 1 -- 172.21.15.53:0/1812023649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5854009420 con 0x7f58600cc560 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.177+0000 7f585effd700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f5860168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.178+0000 7f585ffff700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600cc560 0x7f5860144f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5858009e50 tx=0x7f585800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.178+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800caa0 con 0x7f58600cc560 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.178+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585800f040 con 0x7f58600cc560 2023-09-28T00:22:56.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.178+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58500094f0 con 0x7f58600cc560 2023-09-28T00:22:56.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.178+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800ce50 con 0x7f58600cc560 2023-09-28T00:22:56.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.178+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5860152c40 con 0x7f58600cc560 2023-09-28T00:22:56.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.179+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586004c3c0 con 0x7f58600cc560 2023-09-28T00:22:56.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.180+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5858014690 con 0x7f58600cc560 2023-09-28T00:22:56.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.181+0000 7f58477fe700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f584c067360 0x7f584c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.181+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5858085440 con 0x7f58600cc560 2023-09-28T00:22:56.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.181+0000 7f585f7fe700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f584c067360 0x7f584c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.181+0000 7f585f7fe700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f584c067360 0x7f584c069810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f586006a920 tx=0x7f5850017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:56.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.185+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5858056080 con 0x7f58600cc560 2023-09-28T00:22:56.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.387+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58600cbbf0 con 0x7f58600cc560 2023-09-28T00:22:56.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.387+0000 7f58477fe700 1 -- 172.21.15.53:0/1812023649 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+13695 (secure 0 0 0) 0x7f5858055c10 con 0x7f58600cc560 2023-09-28T00:22:56.387 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:56.388 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":21,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:55.165213+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f584c067360 msgr2=0x7f584c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f584c067360 0x7f584c069810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f586006a920 tx=0x7f5850017000 comp rx=0 tx=0).stop 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600cc560 msgr2=0x7f5860144f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600cc560 0x7f5860144f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5858009e50 tx=0x7f585800b040 comp rx=0 tx=0).stop 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 shutdown_connections 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f584c067360 0x7f584c069810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600cc560 0x7f5860144f80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5860069ca0 0x7f5860158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 --2- 172.21.15.53:0/1812023649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58600add50 0x7f5860168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 >> 172.21.15.53:0/1812023649 conn(0x7f586006f7f0 msgr2=0x7f58600cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:56.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 shutdown_connections 2023-09-28T00:22:56.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.390+0000 7f5864b9d700 1 -- 172.21.15.53:0/1812023649 wait complete. 2023-09-28T00:22:56.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:22:45.151575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:22:52.312450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-28T00:22:56.408 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:22:56.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.598+0000 7f024a39d700 1 Processor -- start 2023-09-28T00:22:56.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.598+0000 7f024a39d700 1 -- start start 2023-09-28T00:22:56.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024a39d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f024414bf50 0x7f02441553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024a39d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02441568c0 0x7f0244068740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024a39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024a39d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0244063710 con 0x7f02441568c0 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024a39d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024406cc40 con 0x7f024414bf50 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024a39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024406bab0 con 0x7f0244156cf0 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02441568c0 0x7f0244068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02441568c0 0x7f0244068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36626/0 (socket says 172.21.15.53:36626) 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 -- 172.21.15.53:0/2699093591 learned_addr learned my addr 172.21.15.53:0/2699093591 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f024939b700 1 --2- 172.21.15.53:0/2699093591 >> v2:172.21.15.118:3300/0 conn(0x7f024414bf50 0x7f02441553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0249b9c700 1 --2- 172.21.15.53:0/2699093591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 -- 172.21.15.53:0/2699093591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 msgr2=0x7f0244068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 --2- 172.21.15.53:0/2699093591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 -- 172.21.15.53:0/2699093591 >> v2:172.21.15.118:3300/0 conn(0x7f024414bf50 msgr2=0x7f02441553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 --2- 172.21.15.53:0/2699093591 >> v2:172.21.15.118:3300/0 conn(0x7f024414bf50 0x7f02441553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.600+0000 7f0248b9a700 1 -- 172.21.15.53:0/2699093591 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024406bd50 con 0x7f02441568c0 2023-09-28T00:22:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.601+0000 7f0248b9a700 1 --2- 172.21.15.53:0/2699093591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02441568c0 0x7f0244068740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f024414fc70 tx=0x7f0234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae939dba8064c7ac server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:56.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.601+0000 7f023bfff700 1 -- 172.21.15.53:0/2699093591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400b6d0 con 0x7f02441568c0 2023-09-28T00:22:56.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.601+0000 7f023bfff700 1 -- 172.21.15.53:0/2699093591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400b830 con 0x7f02441568c0 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.601+0000 7f023bfff700 1 -- 172.21.15.53:0/2699093591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400bbf0 con 0x7f02441568c0 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.601+0000 7f024a39d700 1 -- 172.21.15.53:0/2699093591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02441568c0 msgr2=0x7f0244068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.601+0000 7f024a39d700 1 --2- 172.21.15.53:0/2699093591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02441568c0 0x7f0244068740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f024414fc70 tx=0x7f0234009250 comp rx=0 tx=0).stop 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 -- 172.21.15.53:0/2699093591 shutdown_connections 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 --2- 172.21.15.53:0/2699093591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 --2- 172.21.15.53:0/2699093591 >> v2:172.21.15.118:3300/0 conn(0x7f024414bf50 0x7f02441553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 --2- 172.21.15.53:0/2699093591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02441568c0 0x7f0244068740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 -- 172.21.15.53:0/2699093591 >> 172.21.15.53:0/2699093591 conn(0x7f0244067630 msgr2=0x7f0244067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 -- 172.21.15.53:0/2699093591 shutdown_connections 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.602+0000 7f024a39d700 1 -- 172.21.15.53:0/2699093591 wait complete. 2023-09-28T00:22:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.603+0000 7f024a39d700 1 Processor -- start 2023-09-28T00:22:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.603+0000 7f024a39d700 1 -- start start 2023-09-28T00:22:56.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024a39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 0x7f024414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024a39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02441568c0 0x7f0244147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024a39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024a39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244166410 con 0x7f024414bf50 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024a39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244169900 con 0x7f02441568c0 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024a39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0244165690 con 0x7f0244156cf0 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024939b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 0x7f024414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024939b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 0x7f024414d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36640/0 (socket says 172.21.15.53:36640) 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f024939b700 1 -- 172.21.15.53:0/1897580386 learned_addr learned my addr 172.21.15.53:0/1897580386 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:56.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f0248b9a700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02441568c0 0x7f0244147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.604+0000 7f0249b9c700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024939b700 1 -- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 msgr2=0x7f0244147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024939b700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024939b700 1 -- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02441568c0 msgr2=0x7f0244147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024939b700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02441568c0 0x7f0244147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024939b700 1 -- 172.21.15.53:0/1897580386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340094f0 con 0x7f024414bf50 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024939b700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 0x7f024414d130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f024000ec80 tx=0x7f02400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000c8e0 con 0x7f024414bf50 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000ca40 con 0x7f024414bf50 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000cde0 con 0x7f024414bf50 2023-09-28T00:22:56.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0244169620 con 0x7f024414bf50 2023-09-28T00:22:56.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.605+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0244165c10 con 0x7f024414bf50 2023-09-28T00:22:56.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.606+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024404c3c0 con 0x7f024414bf50 2023-09-28T00:22:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.607+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0240013680 con 0x7f024414bf50 2023-09-28T00:22:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.608+0000 7f02397fa700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0228067330 0x7f02280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.608+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0240084be0 con 0x7f024414bf50 2023-09-28T00:22:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.608+0000 7f0248b9a700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0228067330 0x7f02280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.609+0000 7f0248b9a700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0228067330 0x7f02280697e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f024414fc70 tx=0x7f0234017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.612+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0240051d90 con 0x7f024414bf50 2023-09-28T00:22:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.814+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02440c45e0 con 0x7f024414bf50 2023-09-28T00:22:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.815+0000 7f02397fa700 1 -- 172.21.15.53:0/1897580386 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02400170a0 con 0x7f024414bf50 2023-09-28T00:22:56.815 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-09-28T00:22:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0228067330 msgr2=0x7f02280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0228067330 0x7f02280697e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f024414fc70 tx=0x7f0234017000 comp rx=0 tx=0).stop 2023-09-28T00:22:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 msgr2=0x7f024414d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 0x7f024414d130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f024000ec80 tx=0x7f02400091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 shutdown_connections 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0228067330 0x7f02280697e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0244156cf0 0x7f0244147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024414bf50 0x7f024414d130 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 --2- 172.21.15.53:0/1897580386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02441568c0 0x7f0244147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 >> 172.21.15.53:0/1897580386 conn(0x7f0244067630 msgr2=0x7f024414a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 shutdown_connections 2023-09-28T00:22:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:56.817+0000 7f024a39d700 1 -- 172.21.15.53:0/1897580386 wait complete. 2023-09-28T00:22:56.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:22:57.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.024+0000 7fc1a299d700 1 Processor -- start 2023-09-28T00:22:57.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.024+0000 7fc1a299d700 1 -- start start 2023-09-28T00:22:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a299d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a299d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc19c13ed20 0x7fc19c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a299d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c156040 con 0x7fc19c0c11e0 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a299d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19c0c6cf0 con 0x7fc19c13ed20 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a299d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0c6730 con 0x7fc19c0c0e10 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a219c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc19c13ed20 0x7fc19c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.025+0000 7fc1a199b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc19c13ed20 0x7fc19c0cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36654/0 (socket says 172.21.15.53:36654) 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a119a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc19c0c11e0 0x7fc19c13e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:51758/0 (socket says 172.21.15.53:51758) 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a199b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41010/0 (socket says 172.21.15.53:41010) 2023-09-28T00:22:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 -- 172.21.15.53:0/516899229 learned_addr learned my addr 172.21.15.53:0/516899229 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 -- 172.21.15.53:0/516899229 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 msgr2=0x7fc19c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a0999700 1 -- 172.21.15.53:0/516899229 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411329959 0 0) 0x7fc19c156040 con 0x7fc19c0c11e0 2023-09-28T00:22:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 --2- 172.21.15.53:0/516899229 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 -- 172.21.15.53:0/516899229 >> v1:172.21.15.118:6789/0 conn(0x7fc19c0c11e0 legacy=0x7fc19c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 -- 172.21.15.53:0/516899229 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c0c6a10 con 0x7fc19c13ed20 2023-09-28T00:22:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a219c700 1 --2- 172.21.15.53:0/516899229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c13ed20 0x7fc19c0cc580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc194009f50 tx=0x7fc194009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64897117649b2504 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.026+0000 7fc1a0999700 1 -- 172.21.15.53:0/516899229 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19400e070 con 0x7fc19c13ed20 2023-09-28T00:22:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a0999700 1 -- 172.21.15.53:0/516899229 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19400b9c0 con 0x7fc19c13ed20 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a0999700 1 -- 172.21.15.53:0/516899229 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1940092e0 con 0x7fc19c13ed20 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 -- 172.21.15.53:0/516899229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c13ed20 msgr2=0x7fc19c0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 --2- 172.21.15.53:0/516899229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c13ed20 0x7fc19c0cc580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc194009f50 tx=0x7fc194009840 comp rx=0 tx=0).stop 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 -- 172.21.15.53:0/516899229 shutdown_connections 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 --2- 172.21.15.53:0/516899229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c13ed20 0x7fc19c0cc580 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 --2- 172.21.15.53:0/516899229 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 -- 172.21.15.53:0/516899229 >> 172.21.15.53:0/516899229 conn(0x7fc19c06f830 msgr2=0x7fc19c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 -- 172.21.15.53:0/516899229 shutdown_connections 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.027+0000 7fc1a299d700 1 -- 172.21.15.53:0/516899229 wait complete. 2023-09-28T00:22:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.029+0000 7fc1a299d700 1 Processor -- start 2023-09-28T00:22:57.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.029+0000 7fc1a299d700 1 -- start start 2023-09-28T00:22:57.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a299d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c1659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a299d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 0x7fc19c069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a299d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c13ed20 0x7fc19c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a299d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c158310 con 0x7fc19c0c11e0 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a299d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c156620 con 0x7fc19c13ed20 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a299d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c157420 con 0x7fc19c0c0e10 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 0x7fc19c069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a199b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c1659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 0x7fc19c069d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36670/0 (socket says 172.21.15.53:36670) 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 -- 172.21.15.53:0/4063972694 learned_addr learned my addr 172.21.15.53:0/4063972694 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a219c700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c13ed20 0x7fc19c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 -- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 msgr2=0x7fc19c1659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c1659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 -- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c13ed20 msgr2=0x7fc19c156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.030+0000 7fc1a119a700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c13ed20 0x7fc19c156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc1a119a700 1 -- 172.21.15.53:0/4063972694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194009ae0 con 0x7fc19c0c11e0 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc1a119a700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 0x7fc19c069d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c7e0 tx=0x7fc18c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c005b40 con 0x7fc19c0c11e0 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c005cc0 con 0x7fc19c0c11e0 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c007320 con 0x7fc19c0c11e0 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c157700 con 0x7fc19c0c11e0 2023-09-28T00:22:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.031+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c157fa0 con 0x7fc19c0c11e0 2023-09-28T00:22:57.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.032+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c157c20 con 0x7fc19c0c11e0 2023-09-28T00:22:57.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.033+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc18c01b3b0 con 0x7fc19c0c11e0 2023-09-28T00:22:57.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.034+0000 7fc191ffb700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc180067330 0x7fc1800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.034+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc18c083e70 con 0x7fc19c0c11e0 2023-09-28T00:22:57.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.034+0000 7fc1a199b700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc180067330 0x7fc1800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.035+0000 7fc1a199b700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc180067330 0x7fc1800697e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc198009db0 tx=0x7fc1980091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.038+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc19c157c20 con 0x7fc19c0c11e0 2023-09-28T00:22:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.242+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc19c157e00 con 0x7fc19c0c11e0 2023-09-28T00:22:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.243+0000 7fc191ffb700 1 -- 172.21.15.53:0/4063972694 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc19c157e00 con 0x7fc19c0c11e0 2023-09-28T00:22:57.243 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc180067330 msgr2=0x7fc1800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc180067330 0x7fc1800697e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc198009db0 tx=0x7fc1980091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 msgr2=0x7fc19c069d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 0x7fc19c069d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c7e0 tx=0x7fc18c007de0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 shutdown_connections 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc180067330 0x7fc1800697e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc19c0c0e10 0x7fc19c1659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc19c13ed20 0x7fc19c156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 --2- 172.21.15.53:0/4063972694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c0c11e0 0x7fc19c069d60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 >> 172.21.15.53:0/4063972694 conn(0x7fc19c06f830 msgr2=0x7fc19c154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 shutdown_connections 2023-09-28T00:22:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.245+0000 7fc1a299d700 1 -- 172.21.15.53:0/4063972694 wait complete. 2023-09-28T00:22:57.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-28T00:22:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.450+0000 7f353539d700 1 Processor -- start 2023-09-28T00:22:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.450+0000 7f353539d700 1 -- start start 2023-09-28T00:22:57.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.451+0000 7f353539d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35300add10 0x7f3530155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.451+0000 7f353539d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530159610 0x7f353014f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.451+0000 7f353539d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3530159b20 con 0x7f3530068b60 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.451+0000 7f353539d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300c7350 con 0x7f35300add10 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.451+0000 7f353539d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3530155b50 con 0x7f3530159610 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3530068b60 0x7f35300ae0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36132/0 (socket says 172.21.15.53:36132) 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352f7fe700 1 -- 172.21.15.53:0/2616332686 learned_addr learned my addr 172.21.15.53:0/2616332686 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352ffff700 1 --2- 172.21.15.53:0/2616332686 >> v2:172.21.15.118:3300/0 conn(0x7f35300add10 0x7f3530155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f3534b9c700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530159610 0x7f353014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352ffff700 1 -- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530159610 msgr2=0x7f353014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352ffff700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530159610 0x7f353014f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352ffff700 1 -- 172.21.15.53:0/2616332686 >> v1:172.21.15.53:6789/0 conn(0x7f3530068b60 legacy=0x7f35300ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352ffff700 1 -- 172.21.15.53:0/2616332686 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300ae7f0 con 0x7f35300add10 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f352effd700 1 -- 172.21.15.53:0/2616332686 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081226982 0 0) 0x7f3530159b20 con 0x7f3530068b60 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.452+0000 7f3534b9c700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530159610 0x7f353014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f352ffff700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f3530155fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f35200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd65a63a63755f96 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f352effd700 1 -- 172.21.15.53:0/2616332686 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520009e80 con 0x7f35300add10 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f352effd700 1 -- 172.21.15.53:0/2616332686 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000b860 con 0x7f35300add10 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f352effd700 1 -- 172.21.15.53:0/2616332686 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000bbe0 con 0x7f35300add10 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f353539d700 1 -- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 msgr2=0x7f3530155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f353539d700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f3530155fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f35200091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f353539d700 1 -- 172.21.15.53:0/2616332686 shutdown_connections 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f353539d700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530159610 0x7f353014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f353539d700 1 --2- 172.21.15.53:0/2616332686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f3530155fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.453+0000 7f353539d700 1 -- 172.21.15.53:0/2616332686 >> 172.21.15.53:0/2616332686 conn(0x7f353006f7f0 msgr2=0x7f35300cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.454+0000 7f353539d700 1 -- 172.21.15.53:0/2616332686 shutdown_connections 2023-09-28T00:22:57.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.454+0000 7f353539d700 1 -- 172.21.15.53:0/2616332686 wait complete. 2023-09-28T00:22:57.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.455+0000 7f353539d700 1 Processor -- start 2023-09-28T00:22:57.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.455+0000 7f353539d700 1 -- start start 2023-09-28T00:22:57.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f353539d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530068b60 0x7f35300c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f353539d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f35300c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f353539d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3530159610 0x7f3530148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f353539d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c4e20 con 0x7f3530159610 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f353539d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c4280 con 0x7f35300add10 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f353539d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300b1780 con 0x7f3530068b60 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f35300c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f3534b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3530159610 0x7f3530148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f352ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530068b60 0x7f35300c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f35300c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:38484/0 (socket says 172.21.15.53:38484) 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f352ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530068b60 0x7f35300c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41024/0 (socket says 172.21.15.53:41024) 2023-09-28T00:22:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.456+0000 7f352f7fe700 1 -- 172.21.15.53:0/3475430587 learned_addr learned my addr 172.21.15.53:0/3475430587 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3534b9c700 1 -- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530068b60 msgr2=0x7f35300c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3534b9c700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530068b60 0x7f35300c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3534b9c700 1 -- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 msgr2=0x7f35300c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3534b9c700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f35300c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3534b9c700 1 -- 172.21.15.53:0/3475430587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009420 con 0x7f3530159610 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3534b9c700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3530159610 0x7f3530148fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f352800cdf0 tx=0x7f35280077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800ad00 con 0x7f3530159610 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800ae80 con 0x7f3530159610 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35300c44f0 con 0x7f3530159610 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528016680 con 0x7f3530159610 2023-09-28T00:22:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.457+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35300c4ab0 con 0x7f3530159610 2023-09-28T00:22:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.458+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300c4fd0 con 0x7f3530159610 2023-09-28T00:22:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.459+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3528003020 con 0x7f3530159610 2023-09-28T00:22:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.460+0000 7f3517fff700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f351c067330 0x7f351c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.460+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3528012070 con 0x7f3530159610 2023-09-28T00:22:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.460+0000 7f352ffff700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f351c067330 0x7f351c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.461+0000 7f352ffff700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f351c067330 0x7f351c0697e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35200091e0 tx=0x7f3520017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.464+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f35300c4fd0 con 0x7f3530159610 2023-09-28T00:22:57.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.674+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f35300c4fd0 con 0x7f3530159610 2023-09-28T00:22:57.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.675+0000 7f3517fff700 1 -- 172.21.15.53:0/3475430587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7f35300c4fd0 con 0x7f3530159610 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-09-28T00:22:57.675 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-28T00:22:57.676 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-09-28T00:22:57.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f351c067330 msgr2=0x7f351c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f351c067330 0x7f351c0697e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35200091e0 tx=0x7f3520017000 comp rx=0 tx=0).stop 2023-09-28T00:22:57.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3530159610 msgr2=0x7f3530148fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3530159610 0x7f3530148fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f352800cdf0 tx=0x7f35280077c0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 shutdown_connections 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f351c067330 0x7f351c0697e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530068b60 0x7f35300c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3530159610 0x7f3530148fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 --2- 172.21.15.53:0/3475430587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300add10 0x7f35300c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 >> 172.21.15.53:0/3475430587 conn(0x7f353006f7f0 msgr2=0x7f3530153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 shutdown_connections 2023-09-28T00:22:57.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.677+0000 7f353539d700 1 -- 172.21.15.53:0/3475430587 wait complete. 2023-09-28T00:22:57.694 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-28T00:22:57.695 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-28T00:22:57.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.885+0000 7f837d99d700 1 Processor -- start 2023-09-28T00:22:57.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.885+0000 7f837d99d700 1 -- start start 2023-09-28T00:22:57.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.886+0000 7f837d99d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83780ad910 0x7f8378158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.886+0000 7f837d99d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8378158570 0x7f83780abd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.886+0000 7f837d99d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8378157ba0 con 0x7f83780adce0 2023-09-28T00:22:57.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.886+0000 7f837d99d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83781534e0 con 0x7f8378158570 2023-09-28T00:22:57.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.886+0000 7f837d99d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8378156450 con 0x7f83780ad910 2023-09-28T00:22:57.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.886+0000 7f837d19c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8378158570 0x7f83780abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8378158570 0x7f83780abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36700/0 (socket says 172.21.15.53:36700) 2023-09-28T00:22:57.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 -- 172.21.15.53:0/500474029 learned_addr learned my addr 172.21.15.53:0/500474029 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837c99b700 1 --2- 172.21.15.53:0/500474029 >> v2:172.21.15.118:3300/0 conn(0x7f83780ad910 0x7f8378158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 -- 172.21.15.53:0/500474029 >> v2:172.21.15.118:3300/0 conn(0x7f83780ad910 msgr2=0x7f8378158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 --2- 172.21.15.53:0/500474029 >> v2:172.21.15.118:3300/0 conn(0x7f83780ad910 0x7f8378158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 -- 172.21.15.53:0/500474029 >> v1:172.21.15.118:6789/0 conn(0x7f83780adce0 legacy=0x7f83780ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 -- 172.21.15.53:0/500474029 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83781569f0 con 0x7f8378158570 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f83777fe700 1 -- 172.21.15.53:0/500474029 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128280598 0 0) 0x7f8378157ba0 con 0x7f83780adce0 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f837d19c700 1 --2- 172.21.15.53:0/500474029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8378158570 0x7f83780abd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8378089660 tx=0x7f8370009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e4cb82ea48ed07 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.887+0000 7f83777fe700 1 -- 172.21.15.53:0/500474029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000e070 con 0x7f8378158570 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f83777fe700 1 -- 172.21.15.53:0/500474029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000ba20 con 0x7f8378158570 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f83777fe700 1 -- 172.21.15.53:0/500474029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83700092e0 con 0x7f8378158570 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 -- 172.21.15.53:0/500474029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8378158570 msgr2=0x7f83780abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 --2- 172.21.15.53:0/500474029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8378158570 0x7f83780abd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8378089660 tx=0x7f8370009840 comp rx=0 tx=0).stop 2023-09-28T00:22:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 -- 172.21.15.53:0/500474029 shutdown_connections 2023-09-28T00:22:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 --2- 172.21.15.53:0/500474029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8378158570 0x7f83780abd00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 --2- 172.21.15.53:0/500474029 >> v2:172.21.15.118:3300/0 conn(0x7f83780ad910 0x7f8378158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 -- 172.21.15.53:0/500474029 >> 172.21.15.53:0/500474029 conn(0x7f83780cbdc0 msgr2=0x7f83780cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 -- 172.21.15.53:0/500474029 shutdown_connections 2023-09-28T00:22:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.888+0000 7f837d99d700 1 -- 172.21.15.53:0/500474029 wait complete. 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.890+0000 7f837d99d700 1 Processor -- start 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.890+0000 7f837d99d700 1 -- start start 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.890+0000 7f837d99d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 0x7f83780b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.890+0000 7f837d99d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83780adce0 0x7f83780c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837d99d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8378158570 0x7f83780c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837d99d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c3c60 con 0x7f83780ad910 2023-09-28T00:22:57.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837d99d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c3070 con 0x7f8378158570 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837d99d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8378165fa0 con 0x7f83780adce0 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 0x7f83780b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 0x7f83780b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36702/0 (socket says 172.21.15.53:36702) 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 -- 172.21.15.53:0/2383539819 learned_addr learned my addr 172.21.15.53:0/2383539819 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837d19c700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8378158570 0x7f83780c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f8377fff700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83780adce0 0x7f83780c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 -- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83780adce0 msgr2=0x7f83780c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83780adce0 0x7f83780c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 -- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8378158570 msgr2=0x7f83780c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8378158570 0x7f83780c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:57.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 -- 172.21.15.53:0/2383539819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370009ae0 con 0x7f83780ad910 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f8377fff700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83780adce0 0x7f83780c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.891+0000 7f837c99b700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 0x7f83780b0e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f836c00ec80 tx=0x7f836c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.892+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00c850 con 0x7f83780ad910 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.892+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00c9b0 con 0x7f83780ad910 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.892+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00cd50 con 0x7f83780ad910 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.892+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83780c3330 con 0x7f83780ad910 2023-09-28T00:22:57.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.892+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83780c38f0 con 0x7f83780ad910 2023-09-28T00:22:57.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.893+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8378070850 con 0x7f83780ad910 2023-09-28T00:22:57.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.894+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f836c013680 con 0x7f83780ad910 2023-09-28T00:22:57.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.895+0000 7f8374ff9700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f835c067330 0x7f835c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:57.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.895+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f836c084f00 con 0x7f83780ad910 2023-09-28T00:22:57.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.895+0000 7f8377fff700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f835c067330 0x7f835c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:57.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.896+0000 7f8377fff700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f835c067330 0x7f835c0697e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83780c2a00 tx=0x7f8364009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:57.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:57.899+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f836c0520b0 con 0x7f83780ad910 2023-09-28T00:22:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.099+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8378071830 con 0x7f83780ad910 2023-09-28T00:22:58.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.182+0000 7f8374ff9700 1 -- 172.21.15.53:0/2383539819 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f836c0556d0 con 0x7f83780ad910 2023-09-28T00:22:58.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.186+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f835c067330 msgr2=0x7f835c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:58.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.186+0000 7f837d99d700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f835c067330 0x7f835c0697e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83780c2a00 tx=0x7f8364009040 comp rx=0 tx=0).stop 2023-09-28T00:22:58.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.186+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 msgr2=0x7f83780b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:58.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.186+0000 7f837d99d700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 0x7f83780b0e80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f836c00ec80 tx=0x7f836c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.189+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 shutdown_connections 2023-09-28T00:22:58.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.189+0000 7f837d99d700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f835c067330 0x7f835c0697e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.189+0000 7f837d99d700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8378158570 0x7f83780c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.189+0000 7f837d99d700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83780ad910 0x7f83780b0e80 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f836c00ec80 tx=0x7f836c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.189+0000 7f837d99d700 1 --2- 172.21.15.53:0/2383539819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83780adce0 0x7f83780c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.190+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 >> 172.21.15.53:0/2383539819 conn(0x7f83780cbdc0 msgr2=0x7f8378153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:58.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.192+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 shutdown_connections 2023-09-28T00:22:58.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.192+0000 7f837d99d700 1 -- 172.21.15.53:0/2383539819 wait complete. 2023-09-28T00:22:58.193 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-09-28T00:22:58.210 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-28T00:22:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.404+0000 7f4e58f9d700 1 Processor -- start 2023-09-28T00:22:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.404+0000 7f4e58f9d700 1 -- start start 2023-09-28T00:22:58.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.405+0000 7f4e58f9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4e540c0e10 0x7f4e54159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.405+0000 7f4e58f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e540cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.405+0000 7f4e58f9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e54156040 con 0x7f4e540c11e0 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.405+0000 7f4e58f9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540c6cf0 con 0x7f4e540c0e10 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.405+0000 7f4e58f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c6730 con 0x7f4e5413ed20 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.405+0000 7f4e52ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4e540c11e0 0x7f4e5413e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36146/0 (socket says 172.21.15.53:36146) 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e52ffd700 1 -- 172.21.15.53:0/2772509706 learned_addr learned my addr 172.21.15.53:0/2772509706 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e53fff700 1 --2- 172.21.15.53:0/2772509706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e540cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e537fe700 1 --2- 172.21.15.53:0/2772509706 >> v2:172.21.15.118:3300/0 conn(0x7f4e540c0e10 0x7f4e54159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e527fc700 1 -- 172.21.15.53:0/2772509706 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423852049 0 0) 0x7f4e54156040 con 0x7f4e540c11e0 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e527fc700 1 -- 172.21.15.53:0/2772509706 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c003570 con 0x7f4e540c11e0 2023-09-28T00:22:58.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e53fff700 1 -- 172.21.15.53:0/2772509706 >> v2:172.21.15.118:3300/0 conn(0x7f4e540c0e10 msgr2=0x7f4e54159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e53fff700 1 --2- 172.21.15.53:0/2772509706 >> v2:172.21.15.118:3300/0 conn(0x7f4e540c0e10 0x7f4e54159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e53fff700 1 -- 172.21.15.53:0/2772509706 >> v1:172.21.15.53:6789/0 conn(0x7f4e540c11e0 legacy=0x7f4e5413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e53fff700 1 -- 172.21.15.53:0/2772509706 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540c6a10 con 0x7f4e5413ed20 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e53fff700 1 --2- 172.21.15.53:0/2772509706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e540cc580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009e60 tx=0x7f4e4c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ae36c02a64234a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.406+0000 7f4e527fc700 1 -- 172.21.15.53:0/2772509706 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00e070 con 0x7f4e5413ed20 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e527fc700 1 -- 172.21.15.53:0/2772509706 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00bab0 con 0x7f4e5413ed20 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e527fc700 1 -- 172.21.15.53:0/2772509706 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00be70 con 0x7f4e5413ed20 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2772509706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 msgr2=0x7f4e540cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2772509706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e540cc580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009e60 tx=0x7f4e4c009780 comp rx=0 tx=0).stop 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2772509706 shutdown_connections 2023-09-28T00:22:58.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2772509706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e540cc580 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2772509706 >> v2:172.21.15.118:3300/0 conn(0x7f4e540c0e10 0x7f4e54159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2772509706 >> 172.21.15.53:0/2772509706 conn(0x7f4e5406f830 msgr2=0x7f4e540cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:58.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2772509706 shutdown_connections 2023-09-28T00:22:58.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.407+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2772509706 wait complete. 2023-09-28T00:22:58.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.409+0000 7f4e58f9d700 1 Processor -- start 2023-09-28T00:22:58.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.409+0000 7f4e58f9d700 1 -- start start 2023-09-28T00:22:58.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e58f9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 0x7f4e54168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:58.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e58f9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e540c11e0 0x7f4e540b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e58f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e5413c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e58f9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c5000 con 0x7f4e540c0e10 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e58f9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c5490 con 0x7f4e540c11e0 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e58f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54169910 con 0x7f4e5413ed20 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 0x7f4e54168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 0x7f4e54168e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36718/0 (socket says 172.21.15.53:36718) 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 -- 172.21.15.53:0/2533550115 learned_addr learned my addr 172.21.15.53:0/2533550115 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e53fff700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e5413c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:58.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e52ffd700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e540c11e0 0x7f4e540b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 -- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 msgr2=0x7f4e5413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e5413c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 -- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e540c11e0 msgr2=0x7f4e540b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e540c11e0 0x7f4e540b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e537fe700 1 -- 172.21.15.53:0/2533550115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c009a20 con 0x7f4e540c0e10 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.410+0000 7f4e53fff700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e5413c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.411+0000 7f4e537fe700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 0x7f4e54168e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400ecb0 tx=0x7f4e440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:58.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.411+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400c850 con 0x7f4e540c0e10 2023-09-28T00:22:58.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.411+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400c9b0 con 0x7f4e540c0e10 2023-09-28T00:22:58.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.411+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540c43f0 con 0x7f4e540c0e10 2023-09-28T00:22:58.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.411+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400cd50 con 0x7f4e540c0e10 2023-09-28T00:22:58.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.411+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540c49b0 con 0x7f4e540c0e10 2023-09-28T00:22:58.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.412+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e540c52e0 con 0x7f4e540c0e10 2023-09-28T00:22:58.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.413+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4e44013680 con 0x7f4e540c0e10 2023-09-28T00:22:58.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.414+0000 7f4e3b7fe700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4e40067330 0x7f4e400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:58.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.414+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f4e44084cd0 con 0x7f4e540c0e10 2023-09-28T00:22:58.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.414+0000 7f4e52ffd700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4e40067330 0x7f4e400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:58.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.415+0000 7f4e52ffd700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4e40067330 0x7f4e400697e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e5413d530 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:58.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.419+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4e44051d10 con 0x7f4e540c0e10 2023-09-28T00:22:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:58.621+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4e5404c3c0 con 0x7f4e540c0e10 2023-09-28T00:22:59.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:22:59.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:22:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.188+0000 7f4e3b7fe700 1 -- 172.21.15.53:0/2533550115 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v23) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4e44055330 con 0x7f4e540c0e10 2023-09-28T00:22:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.198+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4e40067330 msgr2=0x7f4e400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.198+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4e40067330 0x7f4e400697e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e5413d530 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2023-09-28T00:22:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.198+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 msgr2=0x7f4e54168e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.198+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 0x7f4e54168e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400ecb0 tx=0x7f4e440091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.199+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 shutdown_connections 2023-09-28T00:22:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.199+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4e40067330 0x7f4e400697e0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e5413d530 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2023-09-28T00:22:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.199+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e5413ed20 0x7f4e5413c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.199+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e540c0e10 0x7f4e54168e00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.199+0000 7f4e58f9d700 1 --2- 172.21.15.53:0/2533550115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e540c11e0 0x7f4e540b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.199+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 >> 172.21.15.53:0/2533550115 conn(0x7f4e5406f830 msgr2=0x7f4e54068bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.201+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 shutdown_connections 2023-09-28T00:22:59.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.203+0000 7f4e58f9d700 1 -- 172.21.15.53:0/2533550115 wait complete. 2023-09-28T00:22:59.210 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-09-28T00:22:59.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-28T00:22:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.419+0000 7f856759e700 1 Processor -- start 2023-09-28T00:22:59.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.420+0000 7f856759e700 1 -- start start 2023-09-28T00:22:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856759e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f856814f7c0 0x7f856806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856806c550 0x7f856806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856759e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856806cab0 con 0x7f8568155750 2023-09-28T00:22:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856759e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85680c5070 con 0x7f856814f7c0 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8568159970 con 0x7f856806c550 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f856814f7c0 0x7f856806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f856814f7c0 0x7f856806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36726/0 (socket says 172.21.15.53:36726) 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f856659c700 1 -- 172.21.15.53:0/3733596056 learned_addr learned my addr 172.21.15.53:0/3733596056 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.421+0000 7f8565d9b700 1 --2- 172.21.15.53:0/3733596056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856806c550 0x7f856806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856659c700 1 -- 172.21.15.53:0/3733596056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856806c550 msgr2=0x7f856806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856659c700 1 --2- 172.21.15.53:0/3733596056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856806c550 0x7f856806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856659c700 1 -- 172.21.15.53:0/3733596056 >> v1:172.21.15.118:6789/0 conn(0x7f8568155750 legacy=0x7f8568067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856659c700 1 -- 172.21.15.53:0/3733596056 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568158cf0 con 0x7f856814f7c0 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856659c700 1 --2- 172.21.15.53:0/3733596056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f856806f120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85580099b0 tx=0x7f8558009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bedfd7f1b854cb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856559a700 1 -- 172.21.15.53:0/3733596056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558009ea0 con 0x7f856814f7c0 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856559a700 1 -- 172.21.15.53:0/3733596056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800b860 con 0x7f856814f7c0 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.422+0000 7f856559a700 1 -- 172.21.15.53:0/3733596056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800bc00 con 0x7f856814f7c0 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 -- 172.21.15.53:0/3733596056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 msgr2=0x7f856806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 --2- 172.21.15.53:0/3733596056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f856806f120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85580099b0 tx=0x7f8558009250 comp rx=0 tx=0).stop 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 -- 172.21.15.53:0/3733596056 shutdown_connections 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 --2- 172.21.15.53:0/3733596056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f856806f120 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 --2- 172.21.15.53:0/3733596056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f856806c550 0x7f856806f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 -- 172.21.15.53:0/3733596056 >> 172.21.15.53:0/3733596056 conn(0x7f8568068740 msgr2=0x7f8568068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:59.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 -- 172.21.15.53:0/3733596056 shutdown_connections 2023-09-28T00:22:59.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.423+0000 7f856759e700 1 -- 172.21.15.53:0/3733596056 wait complete. 2023-09-28T00:22:59.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.424+0000 7f856759e700 1 Processor -- start 2023-09-28T00:22:59.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.424+0000 7f856759e700 1 -- start start 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f856759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856806c550 0x7f856814d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f856759e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f85681687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f856759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8568155750 0x7f856814b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f856759e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680c2770 con 0x7f856814f7c0 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f856759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680c22e0 con 0x7f856806c550 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f856759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8568158960 con 0x7f8568155750 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.425+0000 7f8565d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f85681687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f856659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856806c550 0x7f856814d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8566d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8568155750 0x7f856814b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8566d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8568155750 0x7f856814b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41080/0 (socket says 172.21.15.53:41080) 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f85681687e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36734/0 (socket says 172.21.15.53:36734) 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8566d9d700 1 -- 172.21.15.53:0/3282056765 learned_addr learned my addr 172.21.15.53:0/3282056765 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f856659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856806c550 0x7f856814d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:38536/0 (socket says 172.21.15.53:38536) 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 -- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8568155750 msgr2=0x7f856814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8568155750 0x7f856814b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 -- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856806c550 msgr2=0x7f856814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856806c550 0x7f856814d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 -- 172.21.15.53:0/3282056765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580094f0 con 0x7f856814f7c0 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f8565d9b700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f85681687e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f855c00ea80 tx=0x7f855c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c00eec0 con 0x7f856814f7c0 2023-09-28T00:22:59.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c00c7f0 con 0x7f856814f7c0 2023-09-28T00:22:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c00cb70 con 0x7f856814f7c0 2023-09-28T00:22:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.426+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85680c19f0 con 0x7f856814f7c0 2023-09-28T00:22:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.427+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8568158680 con 0x7f856814f7c0 2023-09-28T00:22:59.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.427+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856804c3c0 con 0x7f856814f7c0 2023-09-28T00:22:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.428+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f855c013470 con 0x7f856814f7c0 2023-09-28T00:22:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.429+0000 7f85567fc700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8548067330 0x7f85480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.429+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f855c084d30 con 0x7f856814f7c0 2023-09-28T00:22:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.430+0000 7f856659c700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8548067330 0x7f85480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.430+0000 7f856659c700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8548067330 0x7f85480697e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85580099b0 tx=0x7f8558017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:59.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.434+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f855c051bf0 con 0x7f856814f7c0 2023-09-28T00:22:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.680+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f856806cce0 con 0x7f856814f7c0 2023-09-28T00:22:59.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.686+0000 7f85567fc700 1 -- 172.21.15.53:0/3282056765 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f855c055210 con 0x7f856814f7c0 2023-09-28T00:22:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.699+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8548067330 msgr2=0x7f85480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.699+0000 7f856759e700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8548067330 0x7f85480697e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85580099b0 tx=0x7f8558017000 comp rx=0 tx=0).stop 2023-09-28T00:22:59.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.699+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 msgr2=0x7f85681687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.699+0000 7f856759e700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f85681687e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f855c00ea80 tx=0x7f855c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.702+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 shutdown_connections 2023-09-28T00:22:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.702+0000 7f856759e700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8548067330 0x7f85480697e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.702+0000 7f856759e700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8568155750 0x7f856814b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.702+0000 7f856759e700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f856806c550 0x7f856814d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.702+0000 7f856759e700 1 --2- 172.21.15.53:0/3282056765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856814f7c0 0x7f85681687e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.702+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 >> 172.21.15.53:0/3282056765 conn(0x7f8568068740 msgr2=0x7f856814c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.704+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 shutdown_connections 2023-09-28T00:22:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.706+0000 7f856759e700 1 -- 172.21.15.53:0/3282056765 wait complete. 2023-09-28T00:22:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 3 and data pool 4 2023-09-28T00:22:59.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:22:59.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.922+0000 7fc371b9d700 1 Processor -- start 2023-09-28T00:22:59.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.922+0000 7fc371b9d700 1 -- start start 2023-09-28T00:22:59.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.923+0000 7fc371b9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc36c1560f0 0x7fc36c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.923+0000 7fc371b9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c0ccaa0 con 0x7fc36c0add50 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.923+0000 7fc371b9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c156550 con 0x7fc36c0cc560 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.923+0000 7fc371b9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0ae830 con 0x7fc36c1560f0 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.923+0000 7fc370b9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc36c0add50 0x7fc36c0ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36160/0 (socket says 172.21.15.53:36160) 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.923+0000 7fc370b9b700 1 -- 172.21.15.53:0/2969967847 learned_addr learned my addr 172.21.15.53:0/2969967847 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc37139c700 1 --2- 172.21.15.53:0/2969967847 >> v2:172.21.15.53:3300/0 conn(0x7fc36c1560f0 0x7fc36c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc36b7fe700 1 -- 172.21.15.53:0/2969967847 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093387864 0 0) 0x7fc36c0ccaa0 con 0x7fc36c0add50 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc37139c700 1 -- 172.21.15.53:0/2969967847 >> v1:172.21.15.118:6789/0 conn(0x7fc36c0cc560 legacy=0x7fc36c069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc37139c700 1 -- 172.21.15.53:0/2969967847 >> v1:172.21.15.53:6789/0 conn(0x7fc36c0add50 legacy=0x7fc36c0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc37139c700 1 -- 172.21.15.53:0/2969967847 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c068c00 con 0x7fc36c1560f0 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc37139c700 1 --2- 172.21.15.53:0/2969967847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c14f410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc364009e60 tx=0x7fc364009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd0826a2703a880 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc36b7fe700 1 -- 172.21.15.53:0/2969967847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400e070 con 0x7fc36c1560f0 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc36b7fe700 1 -- 172.21.15.53:0/2969967847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400bcc0 con 0x7fc36c1560f0 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.924+0000 7fc36b7fe700 1 -- 172.21.15.53:0/2969967847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364012680 con 0x7fc36c1560f0 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 -- 172.21.15.53:0/2969967847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 msgr2=0x7fc36c14f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2969967847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c14f410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc364009e60 tx=0x7fc364009780 comp rx=0 tx=0).stop 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 -- 172.21.15.53:0/2969967847 shutdown_connections 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2969967847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c14f410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 -- 172.21.15.53:0/2969967847 >> 172.21.15.53:0/2969967847 conn(0x7fc36c06f7f0 msgr2=0x7fc36c0cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 -- 172.21.15.53:0/2969967847 shutdown_connections 2023-09-28T00:22:59.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.925+0000 7fc371b9d700 1 -- 172.21.15.53:0/2969967847 wait complete. 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.926+0000 7fc371b9d700 1 Processor -- start 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.927+0000 7fc371b9d700 1 -- start start 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.927+0000 7fc371b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36c0add50 0x7fc36c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc371b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc36c0cc560 0x7fc36c1577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc371b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c168930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc371b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c1695c0 con 0x7fc36c1560f0 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc371b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c156e00 con 0x7fc36c0cc560 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc371b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c156840 con 0x7fc36c0add50 2023-09-28T00:22:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c168930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36748/0 (socket says 172.21.15.53:36748) 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 -- 172.21.15.53:0/2974846670 learned_addr learned my addr 172.21.15.53:0/2974846670 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc370b9b700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36c0add50 0x7fc36c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc36bfff700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc36c0cc560 0x7fc36c1577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 -- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36c0add50 msgr2=0x7fc36c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36c0add50 0x7fc36c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 -- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc36c0cc560 msgr2=0x7fc36c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc36c0cc560 0x7fc36c1577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.928+0000 7fc37139c700 1 -- 172.21.15.53:0/2974846670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364009a20 con 0x7fc36c1560f0 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.929+0000 7fc37139c700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c168930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3640099f0 tx=0x7fc364019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:59.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.929+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400beb0 con 0x7fc36c1560f0 2023-09-28T00:22:59.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.929+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36401b630 con 0x7fc36c1560f0 2023-09-28T00:22:59.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.929+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c158dc0 con 0x7fc36c1560f0 2023-09-28T00:22:59.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.929+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36401b9f0 con 0x7fc36c1560f0 2023-09-28T00:22:59.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.929+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c156a90 con 0x7fc36c1560f0 2023-09-28T00:22:59.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.930+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c156fb0 con 0x7fc36c1560f0 2023-09-28T00:22:59.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.931+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc36401c400 con 0x7fc36c1560f0 2023-09-28T00:22:59.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.931+0000 7fc368ff9700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc350067360 0x7fc350069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:22:59.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.932+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc364086a70 con 0x7fc36c1560f0 2023-09-28T00:22:59.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.932+0000 7fc370b9b700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc350067360 0x7fc350069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:22:59.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.933+0000 7fc370b9b700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc350067360 0x7fc350069810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc360007fd0 tx=0x7fc360007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:22:59.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:22:59.936+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc36c156fb0 con 0x7fc36c1560f0 2023-09-28T00:23:00.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.143+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc36c156fb0 con 0x7fc36c1560f0 2023-09-28T00:23:00.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.144+0000 7fc368ff9700 1 -- 172.21.15.53:0/2974846670 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fc36c156fb0 con 0x7fc36c1560f0 2023-09-28T00:23:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":24,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:59.682104+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc350067360 msgr2=0x7fc350069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc350067360 0x7fc350069810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc360007fd0 tx=0x7fc360007d30 comp rx=0 tx=0).stop 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 msgr2=0x7fc36c168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c168930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3640099f0 tx=0x7fc364019000 comp rx=0 tx=0).stop 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 shutdown_connections 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc350067360 0x7fc350069810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36c0add50 0x7fc36c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c1560f0 0x7fc36c168930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 --2- 172.21.15.53:0/2974846670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc36c0cc560 0x7fc36c1577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 >> 172.21.15.53:0/2974846670 conn(0x7fc36c06f7f0 msgr2=0x7fc36c14d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:00.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 shutdown_connections 2023-09-28T00:23:00.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.146+0000 7fc371b9d700 1 -- 172.21.15.53:0/2974846670 wait complete. 2023-09-28T00:23:00.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:00.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.349+0000 7fa84579d700 1 Processor -- start 2023-09-28T00:23:00.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.349+0000 7fa84579d700 1 -- start start 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa84579d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa84006cdc0 0x7fa8400c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa84579d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8400c51b0 0x7fa8400c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa84579d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa840155940 con 0x7fa84006d190 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa84579d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84006ca10 con 0x7fa84006cdc0 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa84579d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa840150020 con 0x7fa8400c51b0 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa83f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa84006d190 0x7fa84006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36162/0 (socket says 172.21.15.53:36162) 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa83f7fe700 1 -- 172.21.15.53:0/698038500 learned_addr learned my addr 172.21.15.53:0/698038500 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa83ffff700 1 --2- 172.21.15.53:0/698038500 >> v2:172.21.15.118:3300/0 conn(0x7fa84006cdc0 0x7fa8400c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa844f9c700 1 --2- 172.21.15.53:0/698038500 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8400c51b0 0x7fa8400c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa83effd700 1 -- 172.21.15.53:0/698038500 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626128626 0 0) 0x7fa840155940 con 0x7fa84006d190 2023-09-28T00:23:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa83effd700 1 -- 172.21.15.53:0/698038500 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa828003570 con 0x7fa84006d190 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.351+0000 7fa844f9c700 1 -- 172.21.15.53:0/698038500 >> v2:172.21.15.118:3300/0 conn(0x7fa84006cdc0 msgr2=0x7fa8400c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa844f9c700 1 --2- 172.21.15.53:0/698038500 >> v2:172.21.15.118:3300/0 conn(0x7fa84006cdc0 0x7fa8400c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa844f9c700 1 -- 172.21.15.53:0/698038500 >> v1:172.21.15.53:6789/0 conn(0x7fa84006d190 legacy=0x7fa84006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa844f9c700 1 -- 172.21.15.53:0/698038500 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8401566c0 con 0x7fa8400c51b0 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa844f9c700 1 --2- 172.21.15.53:0/698038500 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8400c51b0 0x7fa8400c5650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e60 tx=0x7fa838009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37304473a739f06 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa83effd700 1 -- 172.21.15.53:0/698038500 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800e070 con 0x7fa8400c51b0 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa83effd700 1 -- 172.21.15.53:0/698038500 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800bb40 con 0x7fa8400c51b0 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.352+0000 7fa83effd700 1 -- 172.21.15.53:0/698038500 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838012430 con 0x7fa8400c51b0 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 -- 172.21.15.53:0/698038500 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8400c51b0 msgr2=0x7fa8400c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 --2- 172.21.15.53:0/698038500 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8400c51b0 0x7fa8400c5650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e60 tx=0x7fa838009780 comp rx=0 tx=0).stop 2023-09-28T00:23:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 -- 172.21.15.53:0/698038500 shutdown_connections 2023-09-28T00:23:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 --2- 172.21.15.53:0/698038500 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8400c51b0 0x7fa8400c5650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 --2- 172.21.15.53:0/698038500 >> v2:172.21.15.118:3300/0 conn(0x7fa84006cdc0 0x7fa8400c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 -- 172.21.15.53:0/698038500 >> 172.21.15.53:0/698038500 conn(0x7fa840068740 msgr2=0x7fa840068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 -- 172.21.15.53:0/698038500 shutdown_connections 2023-09-28T00:23:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.353+0000 7fa84579d700 1 -- 172.21.15.53:0/698038500 wait complete. 2023-09-28T00:23:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.354+0000 7fa84579d700 1 Processor -- start 2023-09-28T00:23:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.354+0000 7fa84579d700 1 -- start start 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa84579d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa84006cdc0 0x7fa840150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa84579d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa84006d190 0x7fa840150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa84579d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 0x7fa840147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa84579d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84015ac50 con 0x7fa8400c51b0 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa84579d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84015b370 con 0x7fa84006cdc0 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa84579d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401503c0 con 0x7fa84006d190 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa844f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 0x7fa840147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa844f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 0x7fa840147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36756/0 (socket says 172.21.15.53:36756) 2023-09-28T00:23:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa844f9c700 1 -- 172.21.15.53:0/2450245522 learned_addr learned my addr 172.21.15.53:0/2450245522 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.355+0000 7fa83f7fe700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa84006d190 0x7fa840150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa83ffff700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa84006cdc0 0x7fa840150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa844f9c700 1 -- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa84006d190 msgr2=0x7fa840150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa844f9c700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa84006d190 0x7fa840150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa844f9c700 1 -- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa84006cdc0 msgr2=0x7fa840150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa844f9c700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa84006cdc0 0x7fa840150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa844f9c700 1 -- 172.21.15.53:0/2450245522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838009a20 con 0x7fa8400c51b0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa844f9c700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 0x7fa840147a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa838013000 tx=0x7fa838019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838009420 con 0x7fa8400c51b0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838027470 con 0x7fa8400c51b0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa840159e10 con 0x7fa8400c51b0 2023-09-28T00:23:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.356+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838027810 con 0x7fa8400c51b0 2023-09-28T00:23:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.357+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84015a3b0 con 0x7fa8400c51b0 2023-09-28T00:23:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.358+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa840150190 con 0x7fa8400c51b0 2023-09-28T00:23:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.358+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa838024070 con 0x7fa8400c51b0 2023-09-28T00:23:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.359+0000 7fa827fff700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa82c067330 0x7fa82c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.359+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa838087260 con 0x7fa8400c51b0 2023-09-28T00:23:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.360+0000 7fa83ffff700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa82c067330 0x7fa82c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.360+0000 7fa83ffff700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa82c067330 0x7fa82c0697e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa830009d10 tx=0x7fa8300091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.364+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa840150190 con 0x7fa8400c51b0 2023-09-28T00:23:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.569+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa840071380 con 0x7fa8400c51b0 2023-09-28T00:23:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.570+0000 7fa827fff700 1 -- 172.21.15.53:0/2450245522 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fa838054160 con 0x7fa8400c51b0 2023-09-28T00:23:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:00.571 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":24,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:22:59.682104+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:00.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa82c067330 msgr2=0x7fa82c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa82c067330 0x7fa82c0697e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa830009d10 tx=0x7fa8300091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 msgr2=0x7fa840147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 0x7fa840147a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa838013000 tx=0x7fa838019000 comp rx=0 tx=0).stop 2023-09-28T00:23:00.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 shutdown_connections 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa82c067330 0x7fa82c0697e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8400c51b0 0x7fa840147a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa84006cdc0 0x7fa840150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 --2- 172.21.15.53:0/2450245522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa84006d190 0x7fa840150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 >> 172.21.15.53:0/2450245522 conn(0x7fa840068740 msgr2=0x7fa840154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 shutdown_connections 2023-09-28T00:23:00.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.573+0000 7fa84579d700 1 -- 172.21.15.53:0/2450245522 wait complete. 2023-09-28T00:23:00.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-28T00:23:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.782+0000 7f31fe99d700 1 Processor -- start 2023-09-28T00:23:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.782+0000 7f31fe99d700 1 -- start start 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fe99d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f31f8151da0 0x7f31f80c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fe99d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f806eb10 con 0x7f31f806bf90 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fe99d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f806bb00 con 0x7f31f806f540 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fe99d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f80bf590 con 0x7f31f8151da0 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fe19c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f31f806bf90 0x7f31f814b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36174/0 (socket says 172.21.15.53:36174) 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fe19c700 1 -- 172.21.15.53:0/3851095607 learned_addr learned my addr 172.21.15.53:0/3851095607 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.783+0000 7f31fd99b700 1 --2- 172.21.15.53:0/3851095607 >> v2:172.21.15.118:3300/0 conn(0x7f31f8151da0 0x7f31f80c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fc999700 1 -- 172.21.15.53:0/3851095607 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458831598 0 0) 0x7f31f806eb10 con 0x7f31f806bf90 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fc999700 1 -- 172.21.15.53:0/3851095607 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e4003570 con 0x7f31f806bf90 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fd99b700 1 -- 172.21.15.53:0/3851095607 >> v1:172.21.15.118:6789/0 conn(0x7f31f806f540 legacy=0x7f31f8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fd99b700 1 -- 172.21.15.53:0/3851095607 >> v1:172.21.15.53:6789/0 conn(0x7f31f806bf90 legacy=0x7f31f814b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fd99b700 1 -- 172.21.15.53:0/3851095607 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f806c430 con 0x7f31f8151da0 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fd99b700 1 --2- 172.21.15.53:0/3851095607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8151da0 0x7f31f80c24c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31f40098e0 tx=0x7f31f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b08525e12cb0d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fc999700 1 -- 172.21.15.53:0/3851095607 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400b6d0 con 0x7f31f8151da0 2023-09-28T00:23:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fc999700 1 -- 172.21.15.53:0/3851095607 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400b830 con 0x7f31f8151da0 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.784+0000 7f31fc999700 1 -- 172.21.15.53:0/3851095607 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400bbd0 con 0x7f31f8151da0 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 -- 172.21.15.53:0/3851095607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8151da0 msgr2=0x7f31f80c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 --2- 172.21.15.53:0/3851095607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8151da0 0x7f31f80c24c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31f40098e0 tx=0x7f31f40091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 -- 172.21.15.53:0/3851095607 shutdown_connections 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 --2- 172.21.15.53:0/3851095607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f8151da0 0x7f31f80c24c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 -- 172.21.15.53:0/3851095607 >> 172.21.15.53:0/3851095607 conn(0x7f31f8067630 msgr2=0x7f31f8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 -- 172.21.15.53:0/3851095607 shutdown_connections 2023-09-28T00:23:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.785+0000 7f31fe99d700 1 -- 172.21.15.53:0/3851095607 wait complete. 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.786+0000 7f31fe99d700 1 Processor -- start 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.786+0000 7f31fe99d700 1 -- start start 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.787+0000 7f31fe99d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31f806bf90 0x7f31f8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.787+0000 7f31fe99d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f806f540 0x7f31f80c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.787+0000 7f31fe99d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 0x7f31f80c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.787+0000 7f31fe99d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80bff00 con 0x7f31f8151da0 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.787+0000 7f31fe99d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f8161760 con 0x7f31f806f540 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.787+0000 7f31fe99d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80c4380 con 0x7f31f806bf90 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 0x7f31f80c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 0x7f31f80c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36758/0 (socket says 172.21.15.53:36758) 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 -- 172.21.15.53:0/1855099879 learned_addr learned my addr 172.21.15.53:0/1855099879 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fd19a700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f806f540 0x7f31f80c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fd99b700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31f806bf90 0x7f31f8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 -- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31f806bf90 msgr2=0x7f31f8154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31f806bf90 0x7f31f8154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 -- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f806f540 msgr2=0x7f31f80c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f806f540 0x7f31f80c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 -- 172.21.15.53:0/1855099879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4009420 con 0x7f31f8151da0 2023-09-28T00:23:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe19c700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 0x7f31f80c0890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31f0001460 tx=0x7f31f0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000a920 con 0x7f31f8151da0 2023-09-28T00:23:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000aa80 con 0x7f31f8151da0 2023-09-28T00:23:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ae00 con 0x7f31f8151da0 2023-09-28T00:23:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.788+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f8161a20 con 0x7f31f8151da0 2023-09-28T00:23:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.789+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f8153060 con 0x7f31f8151da0 2023-09-28T00:23:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.790+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f80c0070 con 0x7f31f8151da0 2023-09-28T00:23:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.790+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f31f0007300 con 0x7f31f8151da0 2023-09-28T00:23:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.791+0000 7f31edffb700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f31dc067360 0x7f31dc069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.791+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f31f0085130 con 0x7f31f8151da0 2023-09-28T00:23:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.792+0000 7f31fd99b700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f31dc067360 0x7f31dc069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.792+0000 7f31fd99b700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f31dc067360 0x7f31dc069810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31f40093f0 tx=0x7f31f4017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:00.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:00.795+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f31f80c0070 con 0x7f31f8151da0 2023-09-28T00:23:01.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.043+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f31f80c0070 con 0x7f31f8151da0 2023-09-28T00:23:01.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.694+0000 7f31edffb700 1 -- 172.21.15.53:0/1855099879 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f31f80c0070 con 0x7f31f8151da0 2023-09-28T00:23:01.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f31dc067360 msgr2=0x7f31dc069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f31dc067360 0x7f31dc069810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31f40093f0 tx=0x7f31f4017000 comp rx=0 tx=0).stop 2023-09-28T00:23:01.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 msgr2=0x7f31f80c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 0x7f31f80c0890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31f0001460 tx=0x7f31f0001ae0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 shutdown_connections 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f31dc067360 0x7f31dc069810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31f806bf90 0x7f31f8154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f8151da0 0x7f31f80c0890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 --2- 172.21.15.53:0/1855099879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31f806f540 0x7f31f80c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 >> 172.21.15.53:0/1855099879 conn(0x7f31f8067630 msgr2=0x7f31f80c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 shutdown_connections 2023-09-28T00:23:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.697+0000 7f31fe99d700 1 -- 172.21.15.53:0/1855099879 wait complete. 2023-09-28T00:23:01.717 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2023-09-28T00:23:01.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-09-28T00:23:01.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.912+0000 7fa1c919d700 1 Processor -- start 2023-09-28T00:23:01.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.912+0000 7fa1c919d700 1 -- start start 2023-09-28T00:23:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c919d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa1c406f540 0x7fa1c40c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c919d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c406eb10 con 0x7fa1c406bf90 2023-09-28T00:23:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c919d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c406bb00 con 0x7fa1c4151da0 2023-09-28T00:23:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c919d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c40bf590 con 0x7fa1c406f540 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c899c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa1c406bf90 0x7fa1c414b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36184/0 (socket says 172.21.15.53:36184) 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c899c700 1 -- 172.21.15.53:0/639335659 learned_addr learned my addr 172.21.15.53:0/639335659 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.913+0000 7fa1c37fe700 1 --2- 172.21.15.53:0/639335659 >> v2:172.21.15.118:3300/0 conn(0x7fa1c406f540 0x7fa1c40c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802800909 0 0) 0x7fa1c406eb10 con 0x7fa1c406bf90 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ac003570 con 0x7fa1c406bf90 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223388201 0 0) 0x7fa1c406bb00 con 0x7fa1c4151da0 2023-09-28T00:23:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c406eb10 con 0x7fa1c4151da0 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3750793765 0 0) 0x7fa1ac003570 con 0x7fa1c406bf90 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c37fe700 1 -- 172.21.15.53:0/639335659 >> v1:172.21.15.118:6789/0 conn(0x7fa1c4151da0 legacy=0x7fa1c4152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c37fe700 1 -- 172.21.15.53:0/639335659 >> v1:172.21.15.53:6789/0 conn(0x7fa1c406bf90 legacy=0x7fa1c414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c37fe700 1 -- 172.21.15.53:0/639335659 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c406c430 con 0x7fa1c406f540 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c37fe700 1 --2- 172.21.15.53:0/639335659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c40c24c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098e0 tx=0x7fa1b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae86bfd2e71f2c34 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0017f0 con 0x7fa1c406f540 2023-09-28T00:23:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b8011420 con 0x7fa1c406f540 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.914+0000 7fa1c2ffd700 1 -- 172.21.15.53:0/639335659 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b80117c0 con 0x7fa1c406f540 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 -- 172.21.15.53:0/639335659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 msgr2=0x7fa1c40c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 --2- 172.21.15.53:0/639335659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c40c24c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098e0 tx=0x7fa1b80091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 -- 172.21.15.53:0/639335659 shutdown_connections 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 --2- 172.21.15.53:0/639335659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c40c24c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 -- 172.21.15.53:0/639335659 >> 172.21.15.53:0/639335659 conn(0x7fa1c4067630 msgr2=0x7fa1c4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 -- 172.21.15.53:0/639335659 shutdown_connections 2023-09-28T00:23:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.915+0000 7fa1c919d700 1 -- 172.21.15.53:0/639335659 wait complete. 2023-09-28T00:23:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.916+0000 7fa1c919d700 1 Processor -- start 2023-09-28T00:23:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 -- start start 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 0x7fa1c4147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1c4151da0 0x7fa1c414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c414b840 con 0x7fa1c406bf90 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c414d210 con 0x7fa1c406f540 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.917+0000 7fa1c919d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c414b9b0 con 0x7fa1c4151da0 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 0x7fa1c4147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 0x7fa1c4147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36764/0 (socket says 172.21.15.53:36764) 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 -- 172.21.15.53:0/162858640 learned_addr learned my addr 172.21.15.53:0/162858640 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c37fe700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c899c700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1c4151da0 0x7fa1c414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 -- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1c4151da0 msgr2=0x7fa1c414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1c4151da0 0x7fa1c414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 -- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 msgr2=0x7fa1c414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c414e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 -- 172.21.15.53:0/162858640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8009420 con 0x7fa1c406bf90 2023-09-28T00:23:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c899c700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1c4151da0 0x7fa1c414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.918+0000 7fa1c3fff700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 0x7fa1c4147ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400c580 tx=0x7fa1b4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.919+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4010510 con 0x7fa1c406bf90 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.919+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4010670 con 0x7fa1c406bf90 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.919+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4010a30 con 0x7fa1c406bf90 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.919+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c414b560 con 0x7fa1c406bf90 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.919+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c414bc00 con 0x7fa1c406bf90 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.920+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c4069130 con 0x7fa1c406bf90 2023-09-28T00:23:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.921+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa1b401b400 con 0x7fa1c406bf90 2023-09-28T00:23:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.922+0000 7fa1abfff700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa1b0067360 0x7fa1b0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.922+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa1b4084810 con 0x7fa1c406bf90 2023-09-28T00:23:01.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.922+0000 7fa1c37fe700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa1b0067360 0x7fa1b0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:01.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.923+0000 7fa1c37fe700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa1b0067360 0x7fa1b0069810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80093f0 tx=0x7fa1b8016000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:01.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:01.926+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa1b4051670 con 0x7fa1c406bf90 2023-09-28T00:23:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.176+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fa1c406d250 con 0x7fa1c406bf90 2023-09-28T00:23:02.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.695+0000 7fa1abfff700 1 -- 172.21.15.53:0/162858640 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa1b4054c90 con 0x7fa1c406bf90 2023-09-28T00:23:02.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa1b0067360 msgr2=0x7fa1b0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:02.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa1b0067360 0x7fa1b0069810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80093f0 tx=0x7fa1b8016000 comp rx=0 tx=0).stop 2023-09-28T00:23:02.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 msgr2=0x7fa1c4147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 0x7fa1c4147ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400c580 tx=0x7fa1b4007e10 comp rx=0 tx=0).stop 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 shutdown_connections 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa1b0067360 0x7fa1b0069810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1c4151da0 0x7fa1c414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c406bf90 0x7fa1c4147ab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 --2- 172.21.15.53:0/162858640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1c406f540 0x7fa1c414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 >> 172.21.15.53:0/162858640 conn(0x7fa1c4067630 msgr2=0x7fa1c40c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 shutdown_connections 2023-09-28T00:23:02.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.698+0000 7fa1c919d700 1 -- 172.21.15.53:0/162858640 wait complete. 2023-09-28T00:23:02.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-28T00:23:02.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.913+0000 7f70df59e700 1 Processor -- start 2023-09-28T00:23:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.913+0000 7f70df59e700 1 -- start start 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.914+0000 7f70df59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c0e10 0x7f70e0159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.914+0000 7f70df59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70e013ed20 0x7f70e00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.914+0000 7f70df59e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e0156040 con 0x7f70e00c11e0 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.914+0000 7f70df59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00c6cf0 con 0x7f70e013ed20 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.914+0000 7f70df59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00c6730 con 0x7f70e00c0e10 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70ddd9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f70e00c11e0 0x7f70e013e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36186/0 (socket says 172.21.15.53:36186) 2023-09-28T00:23:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70ddd9b700 1 -- 172.21.15.53:0/4064598271 learned_addr learned my addr 172.21.15.53:0/4064598271 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70de59c700 1 --2- 172.21.15.53:0/4064598271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c0e10 0x7f70e0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70ded9d700 1 --2- 172.21.15.53:0/4064598271 >> v2:172.21.15.118:3300/0 conn(0x7f70e013ed20 0x7f70e00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70dd59a700 1 -- 172.21.15.53:0/4064598271 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909702251 0 0) 0x7f70e0156040 con 0x7f70e00c11e0 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70dd59a700 1 -- 172.21.15.53:0/4064598271 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c8003570 con 0x7f70e00c11e0 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70de59c700 1 -- 172.21.15.53:0/4064598271 >> v2:172.21.15.118:3300/0 conn(0x7f70e013ed20 msgr2=0x7f70e00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70de59c700 1 --2- 172.21.15.53:0/4064598271 >> v2:172.21.15.118:3300/0 conn(0x7f70e013ed20 0x7f70e00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70de59c700 1 -- 172.21.15.53:0/4064598271 >> v1:172.21.15.53:6789/0 conn(0x7f70e00c11e0 legacy=0x7f70e013e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70de59c700 1 -- 172.21.15.53:0/4064598271 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00c6a10 con 0x7f70e00c0e10 2023-09-28T00:23:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.915+0000 7f70ded9d700 1 --2- 172.21.15.53:0/4064598271 >> v2:172.21.15.118:3300/0 conn(0x7f70e013ed20 0x7f70e00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:02.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70de59c700 1 --2- 172.21.15.53:0/4064598271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c0e10 0x7f70e0159840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009910 tx=0x7f70d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f01ea61d17e3760 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70dd59a700 1 -- 172.21.15.53:0/4064598271 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011630 con 0x7f70e00c0e10 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70dd59a700 1 -- 172.21.15.53:0/4064598271 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0011790 con 0x7f70e00c0e10 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70dd59a700 1 -- 172.21.15.53:0/4064598271 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011b30 con 0x7f70e00c0e10 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 -- 172.21.15.53:0/4064598271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c0e10 msgr2=0x7f70e0159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 --2- 172.21.15.53:0/4064598271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c0e10 0x7f70e0159840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009910 tx=0x7f70d00091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 -- 172.21.15.53:0/4064598271 shutdown_connections 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 --2- 172.21.15.53:0/4064598271 >> v2:172.21.15.118:3300/0 conn(0x7f70e013ed20 0x7f70e00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 --2- 172.21.15.53:0/4064598271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c0e10 0x7f70e0159840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 -- 172.21.15.53:0/4064598271 >> 172.21.15.53:0/4064598271 conn(0x7f70e006f830 msgr2=0x7f70e00cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.916+0000 7f70df59e700 1 -- 172.21.15.53:0/4064598271 shutdown_connections 2023-09-28T00:23:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.917+0000 7f70df59e700 1 -- 172.21.15.53:0/4064598271 wait complete. 2023-09-28T00:23:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.918+0000 7f70df59e700 1 Processor -- start 2023-09-28T00:23:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.918+0000 7f70df59e700 1 -- start start 2023-09-28T00:23:02.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70df59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70e00c0e10 0x7f70e01662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70df59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c11e0 0x7f70e00cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70df59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 0x7f70e00aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70df59e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00c5cc0 con 0x7f70e013ed20 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70df59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00c5f80 con 0x7f70e00c0e10 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70df59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00c4000 con 0x7f70e00c11e0 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70ded9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 0x7f70e00aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70ded9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 0x7f70e00aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36772/0 (socket says 172.21.15.53:36772) 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70ded9d700 1 -- 172.21.15.53:0/1757178825 learned_addr learned my addr 172.21.15.53:0/1757178825 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70ddd9b700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c11e0 0x7f70e00cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.919+0000 7f70de59c700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70e00c0e10 0x7f70e01662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ded9d700 1 -- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c11e0 msgr2=0x7f70e00cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ded9d700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c11e0 0x7f70e00cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ded9d700 1 -- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70e00c0e10 msgr2=0x7f70e01662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ded9d700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70e00c0e10 0x7f70e01662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ded9d700 1 -- 172.21.15.53:0/1757178825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8009a20 con 0x7f70e013ed20 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ded9d700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 0x7f70e00aca10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009f50 tx=0x7f70d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800caf0 con 0x7f70e013ed20 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d800f040 con 0x7f70e013ed20 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0009420 con 0x7f70e013ed20 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800ce80 con 0x7f70e013ed20 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.920+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00c45c0 con 0x7f70e013ed20 2023-09-28T00:23:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.921+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e004c3c0 con 0x7f70e013ed20 2023-09-28T00:23:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.922+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f70d8014690 con 0x7f70e013ed20 2023-09-28T00:23:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.924+0000 7f70ce7fc700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f70c0067360 0x7f70c0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.924+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70d80858c0 con 0x7f70e013ed20 2023-09-28T00:23:02.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.924+0000 7f70de59c700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f70c0067360 0x7f70c0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:02.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.925+0000 7f70de59c700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f70c0067360 0x7f70c0069810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70d00091e0 tx=0x7f70d0017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:02.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:02.928+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f70d8052720 con 0x7f70e013ed20 2023-09-28T00:23:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.183+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f70e00ccbb0 con 0x7f70e013ed20 2023-09-28T00:23:03.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.704+0000 7f70ce7fc700 1 -- 172.21.15.53:0/1757178825 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f70d8055d40 con 0x7f70e013ed20 2023-09-28T00:23:03.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f70c0067360 msgr2=0x7f70c0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:03.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f70c0067360 0x7f70c0069810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70d00091e0 tx=0x7f70d0017000 comp rx=0 tx=0).stop 2023-09-28T00:23:03.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 msgr2=0x7f70e00aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:03.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 0x7f70e00aca10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009f50 tx=0x7f70d800b040 comp rx=0 tx=0).stop 2023-09-28T00:23:03.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 shutdown_connections 2023-09-28T00:23:03.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f70c0067360 0x7f70c0069810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70e013ed20 0x7f70e00aca10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70e00c0e10 0x7f70e01662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 --2- 172.21.15.53:0/1757178825 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70e00c11e0 0x7f70e00cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.707+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 >> 172.21.15.53:0/1757178825 conn(0x7f70e006f830 msgr2=0x7f70e013cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:03.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.708+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 shutdown_connections 2023-09-28T00:23:03.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.708+0000 7f70df59e700 1 -- 172.21.15.53:0/1757178825 wait complete. 2023-09-28T00:23:03.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-09-28T00:23:03.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.932+0000 7ff1d4d9d700 1 Processor -- start 2023-09-28T00:23:03.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.932+0000 7ff1d4d9d700 1 -- start start 2023-09-28T00:23:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1d4d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1d00c0990 0x7ff1d00bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1d4d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d0152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1d4d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d0156a00 con 0x7ff1d00c0d60 2023-09-28T00:23:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1d4d9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d0156560 con 0x7ff1d00c0990 2023-09-28T00:23:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1d4d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00bf260 con 0x7ff1d00c4fe0 2023-09-28T00:23:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1cf7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1d00c0990 0x7ff1d00bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1cf7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1d00c0990 0x7ff1d00bed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36784/0 (socket says 172.21.15.53:36784) 2023-09-28T00:23:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/3251242274 learned_addr learned my addr 172.21.15.53:0/3251242274 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.934+0000 7ff1ceffd700 1 --2- 172.21.15.53:0/3251242274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d0152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/3251242274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 msgr2=0x7ff1d0152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1cf7fe700 1 --2- 172.21.15.53:0/3251242274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d0152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/3251242274 >> v1:172.21.15.118:6789/0 conn(0x7ff1d00c0d60 legacy=0x7ff1d006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1ce7fc700 1 -- 172.21.15.53:0/3251242274 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926922048 0 0) 0x7ff1d0156a00 con 0x7ff1d00c0d60 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/3251242274 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0152a10 con 0x7ff1d00c0990 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1cf7fe700 1 --2- 172.21.15.53:0/3251242274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d00bed20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00099b0 tx=0x7ff1c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f065668ce0cd947b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1ce7fc700 1 -- 172.21.15.53:0/3251242274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0009ea0 con 0x7ff1d00c0990 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1ce7fc700 1 -- 172.21.15.53:0/3251242274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000b860 con 0x7ff1d00c0990 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.935+0000 7ff1ce7fc700 1 -- 172.21.15.53:0/3251242274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000bc00 con 0x7ff1d00c0990 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/3251242274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 msgr2=0x7ff1d00bed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/3251242274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d00bed20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00099b0 tx=0x7ff1c0009250 comp rx=0 tx=0).stop 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/3251242274 shutdown_connections 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/3251242274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d00bed20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/3251242274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d0152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/3251242274 >> 172.21.15.53:0/3251242274 conn(0x7ff1d0067630 msgr2=0x7ff1d0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/3251242274 shutdown_connections 2023-09-28T00:23:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.936+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/3251242274 wait complete. 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.937+0000 7ff1d4d9d700 1 Processor -- start 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 -- start start 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d01469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d00c0d60 0x7ff1d00c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d00c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00c4660 con 0x7ff1d00c0990 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00c2910 con 0x7ff1d00c0d60 2023-09-28T00:23:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.938+0000 7ff1d4d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d01537a0 con 0x7ff1d00c4fe0 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d01469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d01469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36794/0 (socket says 172.21.15.53:36794) 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/2889589548 learned_addr learned my addr 172.21.15.53:0/2889589548 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1ceffd700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d00c0d60 0x7ff1d00c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cffff700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d00c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 msgr2=0x7ff1d00c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d00c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d00c0d60 msgr2=0x7ff1d00c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d00c0d60 0x7ff1d00c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 -- 172.21.15.53:0/2889589548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00094f0 con 0x7ff1d00c0990 2023-09-28T00:23:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.939+0000 7ff1cf7fe700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d01469f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1d006d6b0 tx=0x7ff1c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.940+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0000d10 con 0x7ff1d00c0990 2023-09-28T00:23:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.940+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000bbe0 con 0x7ff1d00c0990 2023-09-28T00:23:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.940+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011690 con 0x7ff1d00c0990 2023-09-28T00:23:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.940+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d00c2020 con 0x7ff1d00c0990 2023-09-28T00:23:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.940+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d00c22c0 con 0x7ff1d00c0990 2023-09-28T00:23:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.941+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d004c3c0 con 0x7ff1d00c0990 2023-09-28T00:23:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.942+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff1c0011ac0 con 0x7ff1d00c0990 2023-09-28T00:23:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.942+0000 7ff1b77fe700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff1bc067360 0x7ff1bc069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.943+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1c00864a0 con 0x7ff1d00c0990 2023-09-28T00:23:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.943+0000 7ff1ceffd700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff1bc067360 0x7ff1bc069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.943+0000 7ff1ceffd700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff1bc067360 0x7ff1bc069810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400b240 tx=0x7ff1c400b430 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:03.947+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff1c0053300 con 0x7ff1d00c0990 2023-09-28T00:23:04.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.197+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7ff1d006f190 con 0x7ff1d00c0990 2023-09-28T00:23:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.708+0000 7ff1b77fe700 1 -- 172.21.15.53:0/2889589548 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff1c0056920 con 0x7ff1d00c0990 2023-09-28T00:23:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff1bc067360 msgr2=0x7ff1bc069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff1bc067360 0x7ff1bc069810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400b240 tx=0x7ff1c400b430 comp rx=0 tx=0).stop 2023-09-28T00:23:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 msgr2=0x7ff1d01469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d01469f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff1d006d6b0 tx=0x7ff1c0017000 comp rx=0 tx=0).stop 2023-09-28T00:23:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 shutdown_connections 2023-09-28T00:23:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff1bc067360 0x7ff1bc069810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1d00c4fe0 0x7ff1d00c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d00c0990 0x7ff1d01469f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 --2- 172.21.15.53:0/2889589548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1d00c0d60 0x7ff1d00c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 >> 172.21.15.53:0/2889589548 conn(0x7ff1d0067630 msgr2=0x7ff1d0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:04.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 shutdown_connections 2023-09-28T00:23:04.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.712+0000 7ff1d4d9d700 1 -- 172.21.15.53:0/2889589548 wait complete. 2023-09-28T00:23:04.736 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-28T00:23:04.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:23:04.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.926+0000 7f503b19d700 1 Processor -- start 2023-09-28T00:23:04.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.926+0000 7f503b19d700 1 -- start start 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503b19d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50340cb050 0x7f5034155f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503b19d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340ca4b0 con 0x7f503414bf10 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503b19d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5034156440 con 0x7f5034089830 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503b19d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340ae5f0 con 0x7f50340cb050 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503a19b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f503414bf10 0x7f50340ad8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36196/0 (socket says 172.21.15.53:36196) 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503a19b700 1 -- 172.21.15.53:0/2163813646 learned_addr learned my addr 172.21.15.53:0/2163813646 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f503a99c700 1 --2- 172.21.15.53:0/2163813646 >> v2:172.21.15.118:3300/0 conn(0x7f50340cb050 0x7f5034155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740035987 0 0) 0x7f50340ca4b0 con 0x7f503414bf10 2023-09-28T00:23:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5020003570 con 0x7f503414bf10 2023-09-28T00:23:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839462496 0 0) 0x7f5034156440 con 0x7f5034089830 2023-09-28T00:23:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.928+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50340ca4b0 con 0x7f5034089830 2023-09-28T00:23:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f503a99c700 1 -- 172.21.15.53:0/2163813646 >> v1:172.21.15.118:6789/0 conn(0x7f5034089830 legacy=0x7f50340ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f503a99c700 1 -- 172.21.15.53:0/2163813646 >> v1:172.21.15.53:6789/0 conn(0x7f503414bf10 legacy=0x7f50340ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f503a99c700 1 -- 172.21.15.53:0/2163813646 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c9bf0 con 0x7f50340cb050 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f503a99c700 1 --2- 172.21.15.53:0/2163813646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50340cb050 0x7f5034155f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f502c009e60 tx=0x7f502c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98512e0112043712 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00e070 con 0x7f50340cb050 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00bab0 con 0x7f50340cb050 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.929+0000 7f5039199700 1 -- 172.21.15.53:0/2163813646 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00be70 con 0x7f50340cb050 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 -- 172.21.15.53:0/2163813646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50340cb050 msgr2=0x7f5034155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 --2- 172.21.15.53:0/2163813646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50340cb050 0x7f5034155f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f502c009e60 tx=0x7f502c009780 comp rx=0 tx=0).stop 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 -- 172.21.15.53:0/2163813646 shutdown_connections 2023-09-28T00:23:04.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 --2- 172.21.15.53:0/2163813646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50340cb050 0x7f5034155f00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 -- 172.21.15.53:0/2163813646 >> 172.21.15.53:0/2163813646 conn(0x7f503406f830 msgr2=0x7f50340cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:04.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 -- 172.21.15.53:0/2163813646 shutdown_connections 2023-09-28T00:23:04.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.930+0000 7f503b19d700 1 -- 172.21.15.53:0/2163813646 wait complete. 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.931+0000 7f503b19d700 1 Processor -- start 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.931+0000 7f503b19d700 1 -- start start 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.932+0000 7f503b19d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5034089830 0x7f50341687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.932+0000 7f503b19d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50340cb050 0x7f503414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.932+0000 7f503b19d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 0x7f503414d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.932+0000 7f503b19d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5034151bb0 con 0x7f503414bf10 2023-09-28T00:23:04.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.932+0000 7f503b19d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503415a940 con 0x7f5034089830 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.932+0000 7f503b19d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5034169540 con 0x7f50340cb050 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 0x7f503414d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 0x7f503414d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36806/0 (socket says 172.21.15.53:36806) 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 -- 172.21.15.53:0/3483664384 learned_addr learned my addr 172.21.15.53:0/3483664384 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503999a700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50340cb050 0x7f503414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a19b700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5034089830 0x7f50341687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 -- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50340cb050 msgr2=0x7f503414d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50340cb050 0x7f503414d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 -- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5034089830 msgr2=0x7f50341687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:04.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5034089830 0x7f50341687e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 -- 172.21.15.53:0/3483664384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009a20 con 0x7f503414bf10 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.933+0000 7f503a99c700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 0x7f503414d800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f502c009460 tx=0x7f502c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.934+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c012dd0 con 0x7f503414bf10 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.934+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c026440 con 0x7f503414bf10 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.934+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503415a710 con 0x7f503414bf10 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.934+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c026800 con 0x7f503414bf10 2023-09-28T00:23:04.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.934+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5034068930 con 0x7f503414bf10 2023-09-28T00:23:04.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.935+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034152130 con 0x7f503414bf10 2023-09-28T00:23:04.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.935+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f502c02f440 con 0x7f503414bf10 2023-09-28T00:23:04.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.936+0000 7f502a7fc700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5018067330 0x7f50180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:04.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.936+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f502c086d00 con 0x7f503414bf10 2023-09-28T00:23:04.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.937+0000 7f503a19b700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5018067330 0x7f50180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:04.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.937+0000 7f503a19b700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5018067330 0x7f50180697e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5030007fd0 tx=0x7f5030009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:04.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:04.941+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5034152130 con 0x7f503414bf10 2023-09-28T00:23:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.187+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5034152130 con 0x7f503414bf10 2023-09-28T00:23:05.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.188+0000 7f502a7fc700 1 -- 172.21.15.53:0/3483664384 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6155 (secure 0 0 0) 0x7f5034152130 con 0x7f503414bf10 2023-09-28T00:23:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:05.188 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:22:59.682569+0000","modified":"2023-09-28T00:23:04.709694+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3],"up":{"mds_0":4299,"mds_1":4296,"mds_2":4291,"mds_3":4271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4271":{"gid":4271,"name":"f","rank":3,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4291":{"gid":4291,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4296":{"gid":4296,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4299":{"gid":4299,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:23:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5018067330 msgr2=0x7f50180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5018067330 0x7f50180697e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5030007fd0 tx=0x7f5030009040 comp rx=0 tx=0).stop 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 msgr2=0x7f503414d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 0x7f503414d800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f502c009460 tx=0x7f502c019000 comp rx=0 tx=0).stop 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 shutdown_connections 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5018067330 0x7f50180697e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f503414bf10 0x7f503414d800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5034089830 0x7f50341687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 --2- 172.21.15.53:0/3483664384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50340cb050 0x7f503414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 >> 172.21.15.53:0/3483664384 conn(0x7f503406f830 msgr2=0x7f503415b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.190+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 shutdown_connections 2023-09-28T00:23:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.191+0000 7f503b19d700 1 -- 172.21.15.53:0/3483664384 wait complete. 2023-09-28T00:23:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-09-28T00:23:05.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:05.305 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-09-28T00:23:05.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-28T00:23:05.305 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-09-28T00:23:05.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-09-28T00:23:05.305 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-09-28T00:23:05.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-09-28T00:23:05.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.395+0000 7f576759e700 1 Processor -- start 2023-09-28T00:23:05.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.395+0000 7f576759e700 1 -- start start 2023-09-28T00:23:05.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576759e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57680cc560 0x7f57681560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5768069ca0 0x7f576806a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576759e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680ccaa0 con 0x7f57680add50 2023-09-28T00:23:05.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576759e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680ae830 con 0x7f57680cc560 2023-09-28T00:23:05.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5768068c00 con 0x7f5768069ca0 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576659c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f57680add50 0x7f57680ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36198/0 (socket says 172.21.15.53:36198) 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f576659c700 1 -- 172.21.15.53:0/2956541884 learned_addr learned my addr 172.21.15.53:0/2956541884 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.396+0000 7f5765d9b700 1 --2- 172.21.15.53:0/2956541884 >> v2:172.21.15.53:3300/0 conn(0x7f57680cc560 0x7f57681560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f5766d9d700 1 --2- 172.21.15.53:0/2956541884 >> v2:172.21.15.118:3300/0 conn(0x7f5768069ca0 0x7f576806a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f5765d9b700 1 -- 172.21.15.53:0/2956541884 >> v2:172.21.15.118:3300/0 conn(0x7f5768069ca0 msgr2=0x7f576806a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f5765d9b700 1 --2- 172.21.15.53:0/2956541884 >> v2:172.21.15.118:3300/0 conn(0x7f5768069ca0 0x7f576806a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f5765d9b700 1 -- 172.21.15.53:0/2956541884 >> v1:172.21.15.53:6789/0 conn(0x7f57680add50 legacy=0x7f57680ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f5765d9b700 1 -- 172.21.15.53:0/2956541884 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768068ee0 con 0x7f57680cc560 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f576559a700 1 -- 172.21.15.53:0/2956541884 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930696487 0 0) 0x7f57680ccaa0 con 0x7f57680add50 2023-09-28T00:23:05.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f5765d9b700 1 --2- 172.21.15.53:0/2956541884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57680cc560 0x7f57681560f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f57680cbde0 tx=0x7f575c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708673e8542f3660 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:05.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f576559a700 1 -- 172.21.15.53:0/2956541884 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00b690 con 0x7f57680cc560 2023-09-28T00:23:05.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f576559a700 1 -- 172.21.15.53:0/2956541884 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c00b7f0 con 0x7f57680cc560 2023-09-28T00:23:05.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.397+0000 7f576559a700 1 -- 172.21.15.53:0/2956541884 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00bb90 con 0x7f57680cc560 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 -- 172.21.15.53:0/2956541884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57680cc560 msgr2=0x7f57681560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 --2- 172.21.15.53:0/2956541884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57680cc560 0x7f57681560f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f57680cbde0 tx=0x7f575c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 -- 172.21.15.53:0/2956541884 shutdown_connections 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 --2- 172.21.15.53:0/2956541884 >> v2:172.21.15.118:3300/0 conn(0x7f5768069ca0 0x7f576806a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 --2- 172.21.15.53:0/2956541884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57680cc560 0x7f57681560f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 -- 172.21.15.53:0/2956541884 >> 172.21.15.53:0/2956541884 conn(0x7f576806f7f0 msgr2=0x7f57680cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 -- 172.21.15.53:0/2956541884 shutdown_connections 2023-09-28T00:23:05.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.398+0000 7f576759e700 1 -- 172.21.15.53:0/2956541884 wait complete. 2023-09-28T00:23:05.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.399+0000 7f576759e700 1 Processor -- start 2023-09-28T00:23:05.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.400+0000 7f576759e700 1 -- start start 2023-09-28T00:23:05.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.400+0000 7f576759e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 0x7f5768169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.400+0000 7f576759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57680add50 0x7f57680afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.400+0000 7f576759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57680cc560 0x7f57680affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576759e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680af5f0 con 0x7f5768069ca0 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57681699f0 con 0x7f57680cc560 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5768169cd0 con 0x7f57680add50 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 0x7f5768169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 0x7f5768169070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36822/0 (socket says 172.21.15.53:36822) 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 -- 172.21.15.53:0/801674437 learned_addr learned my addr 172.21.15.53:0/801674437 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f5766d9d700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57680cc560 0x7f57680affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f5765d9b700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57680add50 0x7f57680afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 -- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57680add50 msgr2=0x7f57680afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57680add50 0x7f57680afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 -- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57680cc560 msgr2=0x7f57680affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57680cc560 0x7f57680affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 -- 172.21.15.53:0/801674437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c009420 con 0x7f5768069ca0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f5765d9b700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57680add50 0x7f57680afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f576659c700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 0x7f5768169070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f575800c7e0 tx=0x7f5758007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.401+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758005b30 con 0x7f5768069ca0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.402+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5758005c90 con 0x7f5768069ca0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.402+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680aecc0 con 0x7f5768069ca0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.402+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758007300 con 0x7f5768069ca0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.402+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57680af280 con 0x7f5768069ca0 2023-09-28T00:23:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.403+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576804c3c0 con 0x7f5768069ca0 2023-09-28T00:23:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.404+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f57580076b0 con 0x7f5768069ca0 2023-09-28T00:23:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.405+0000 7f57567fc700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5748067360 0x7f5748069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.405+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f57580841a0 con 0x7f5768069ca0 2023-09-28T00:23:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.405+0000 7f5765d9b700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5748067360 0x7f5748069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.406+0000 7f5765d9b700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5748067360 0x7f5748069810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f575c0093f0 tx=0x7f575c017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.408+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5758051000 con 0x7f5768069ca0 2023-09-28T00:23:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.612+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57680ac4c0 con 0x7f5768069ca0 2023-09-28T00:23:05.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.613+0000 7f57567fc700 1 -- 172.21.15.53:0/801674437 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f5758054620 con 0x7f5768069ca0 2023-09-28T00:23:05.613 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:05.613 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5748067360 msgr2=0x7f5748069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5748067360 0x7f5748069810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f575c0093f0 tx=0x7f575c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:05.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 msgr2=0x7f5768169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 0x7f5768169070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f575800c7e0 tx=0x7f5758007df0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 shutdown_connections 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5748067360 0x7f5748069810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57680cc560 0x7f57680affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5768069ca0 0x7f5768169070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 --2- 172.21.15.53:0/801674437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57680add50 0x7f57680afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 >> 172.21.15.53:0/801674437 conn(0x7f576806f7f0 msgr2=0x7f576814f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 shutdown_connections 2023-09-28T00:23:05.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.615+0000 7f576759e700 1 -- 172.21.15.53:0/801674437 wait complete. 2023-09-28T00:23:05.633 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-28T00:23:05.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.828+0000 7fb62b59e700 1 Processor -- start 2023-09-28T00:23:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.828+0000 7fb62b59e700 1 -- start start 2023-09-28T00:23:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.829+0000 7fb62b59e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb62c0add50 0x7fb62c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.829+0000 7fb62b59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb62c069ca0 0x7fb62c06a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.829+0000 7fb62b59e700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0ccaa0 con 0x7fb62c0cc560 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.829+0000 7fb62b59e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0ae830 con 0x7fb62c0add50 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.829+0000 7fb62b59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c068c00 con 0x7fb62c069ca0 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb62c0add50 0x7fb62c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb62c0add50 0x7fb62c1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36824/0 (socket says 172.21.15.53:36824) 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 -- 172.21.15.53:0/2144477575 learned_addr learned my addr 172.21.15.53:0/2144477575 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb629d9b700 1 --1- 172.21.15.53:0/2144477575 >> v1:172.21.15.53:6789/0 conn(0x7fb62c0cc560 0x7fb62c0ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36212/0 (socket says 172.21.15.53:36212) 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62ad9d700 1 --2- 172.21.15.53:0/2144477575 >> v2:172.21.15.118:3300/0 conn(0x7fb62c069ca0 0x7fb62c06a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 -- 172.21.15.53:0/2144477575 >> v2:172.21.15.118:3300/0 conn(0x7fb62c069ca0 msgr2=0x7fb62c06a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 --2- 172.21.15.53:0/2144477575 >> v2:172.21.15.118:3300/0 conn(0x7fb62c069ca0 0x7fb62c06a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 -- 172.21.15.53:0/2144477575 >> v1:172.21.15.53:6789/0 conn(0x7fb62c0cc560 legacy=0x7fb62c0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 -- 172.21.15.53:0/2144477575 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c068ee0 con 0x7fb62c0add50 2023-09-28T00:23:05.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62959a700 1 -- 172.21.15.53:0/2144477575 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060953885 0 0) 0x7fb62c0ccaa0 con 0x7fb62c0cc560 2023-09-28T00:23:05.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.830+0000 7fb62a59c700 1 --2- 172.21.15.53:0/2144477575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1560f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0cbde0 tx=0x7fb61c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4c8a60d8ff64a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:05.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62959a700 1 -- 172.21.15.53:0/2144477575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c009e70 con 0x7fb62c0add50 2023-09-28T00:23:05.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62959a700 1 -- 172.21.15.53:0/2144477575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c00b8f0 con 0x7fb62c0add50 2023-09-28T00:23:05.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62959a700 1 -- 172.21.15.53:0/2144477575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00bc90 con 0x7fb62c0add50 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 -- 172.21.15.53:0/2144477575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 msgr2=0x7fb62c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 --2- 172.21.15.53:0/2144477575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1560f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0cbde0 tx=0x7fb61c009250 comp rx=0 tx=0).stop 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 -- 172.21.15.53:0/2144477575 shutdown_connections 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 --2- 172.21.15.53:0/2144477575 >> v2:172.21.15.118:3300/0 conn(0x7fb62c069ca0 0x7fb62c06a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 --2- 172.21.15.53:0/2144477575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1560f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 -- 172.21.15.53:0/2144477575 >> 172.21.15.53:0/2144477575 conn(0x7fb62c06f7f0 msgr2=0x7fb62c0cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 -- 172.21.15.53:0/2144477575 shutdown_connections 2023-09-28T00:23:05.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.831+0000 7fb62b59e700 1 -- 172.21.15.53:0/2144477575 wait complete. 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.833+0000 7fb62b59e700 1 Processor -- start 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.833+0000 7fb62b59e700 1 -- start start 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c069ca0 0x7fb62c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62b59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0cc560 0x7fb62c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62b59e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0b0fc0 con 0x7fb62c0add50 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c156340 con 0x7fb62c0cc560 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1543f0 con 0x7fb62c069ca0 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c069ca0 0x7fb62c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36836/0 (socket says 172.21.15.53:36836) 2023-09-28T00:23:05.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 -- 172.21.15.53:0/997004936 learned_addr learned my addr 172.21.15.53:0/997004936 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62ad9d700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0cc560 0x7fb62c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 -- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c069ca0 msgr2=0x7fb62c146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c069ca0 0x7fb62c146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 -- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0cc560 msgr2=0x7fb62c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0cc560 0x7fb62c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb629d9b700 1 -- 172.21.15.53:0/997004936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0094f0 con 0x7fb62c0add50 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.834+0000 7fb62a59c700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c069ca0 0x7fb62c146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.835+0000 7fb629d9b700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1549b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6200011e0 tx=0x7fb620007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.835+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620005a70 con 0x7fb62c0add50 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.835+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620005bd0 con 0x7fb62c0add50 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.835+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200070d0 con 0x7fb62c0add50 2023-09-28T00:23:05.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.835+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0cbb10 con 0x7fb62c0add50 2023-09-28T00:23:05.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.835+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0c8930 con 0x7fb62c0add50 2023-09-28T00:23:05.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.836+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c04c3c0 con 0x7fb62c0add50 2023-09-28T00:23:05.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.837+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb620007440 con 0x7fb62c0add50 2023-09-28T00:23:05.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.838+0000 7fb61a7fc700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb60c067330 0x7fb60c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:05.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.838+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb620084140 con 0x7fb62c0add50 2023-09-28T00:23:05.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.838+0000 7fb62a59c700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb60c067330 0x7fb60c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:05.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.839+0000 7fb62a59c700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb60c067330 0x7fb60c0697e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0cbde0 tx=0x7fb61c017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:05.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:05.842+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb620050fa0 con 0x7fb62c0add50 2023-09-28T00:23:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.038+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb62c154530 con 0x7fb60c067330 2023-09-28T00:23:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.047+0000 7fb61a7fc700 1 -- 172.21.15.53:0/997004936 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284825 (secure 0 0 0) 0x7fb62c154530 con 0x7fb60c067330 2023-09-28T00:23:06.053 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.051+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb60c067330 msgr2=0x7fb60c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.051+0000 7fb62b59e700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb60c067330 0x7fb60c0697e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0cbde0 tx=0x7fb61c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.051+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 msgr2=0x7fb62c1549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.051+0000 7fb62b59e700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1549b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6200011e0 tx=0x7fb620007e10 comp rx=0 tx=0).stop 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 shutdown_connections 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb60c067330 0x7fb60c0697e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c069ca0 0x7fb62c146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0cc560 0x7fb62c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 --2- 172.21.15.53:0/997004936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c0add50 0x7fb62c1549b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 >> 172.21.15.53:0/997004936 conn(0x7fb62c06f7f0 msgr2=0x7fb62c0ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:06.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 shutdown_connections 2023-09-28T00:23:06.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.052+0000 7fb62b59e700 1 -- 172.21.15.53:0/997004936 wait complete. 2023-09-28T00:23:06.057 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:06.069 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-09-28T00:23:05.102751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595200,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":268,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83008,"kb_used_data":3264,"kb_used_omap":0,"kb_used_meta":79680,"kb_avail":754891712,"statfs":{"total":773094113280,"available":773009113088,"internally_reserved":0,"allocated":3342336,"data_stored":1941842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81592320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4832,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001460"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708075+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.708075+0000","last_peered":"2023-09-28T00:22:59.708075+0000","last_clean":"2023-09-28T00:22:59.708075+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.708075+0000","last_undegraded":"2023-09-28T00:22:59.708075+0000","last_fullsized":"2023-09-28T00:22:59.708075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.702306+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.702306+0000","last_peered":"2023-09-28T00:22:59.702306+0000","last_clean":"2023-09-28T00:22:59.702306+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.702306+0000","last_undegraded":"2023-09-28T00:22:59.702306+0000","last_fullsized":"2023-09-28T00:22:59.702306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.693696+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.693696+0000","last_peered":"2023-09-28T00:22:59.693696+0000","last_clean":"2023-09-28T00:22:59.693696+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.693696+0000","last_undegraded":"2023-09-28T00:22:59.693696+0000","last_fullsized":"2023-09-28T00:22:59.693696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.705340+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.705340+0000","last_peered":"2023-09-28T00:22:59.705340+0000","last_clean":"2023-09-28T00:22:59.705340+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.705340+0000","last_undegraded":"2023-09-28T00:22:59.705340+0000","last_fullsized":"2023-09-28T00:22:59.705340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.716095+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.716095+0000","last_peered":"2023-09-28T00:22:59.716095+0000","last_clean":"2023-09-28T00:22:59.716095+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.716095+0000","last_undegraded":"2023-09-28T00:22:59.716095+0000","last_fullsized":"2023-09-28T00:22:59.716095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703608+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.703608+0000","last_peered":"2023-09-28T00:22:59.703608+0000","last_clean":"2023-09-28T00:22:59.703608+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.703608+0000","last_undegraded":"2023-09-28T00:22:59.703608+0000","last_fullsized":"2023-09-28T00:22:59.703608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.716293+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.716293+0000","last_peered":"2023-09-28T00:22:59.716293+0000","last_clean":"2023-09-28T00:22:59.716293+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.716293+0000","last_undegraded":"2023-09-28T00:22:59.716293+0000","last_fullsized":"2023-09-28T00:22:59.716293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706728+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.706728+0000","last_peered":"2023-09-28T00:22:59.706728+0000","last_clean":"2023-09-28T00:22:59.706728+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.706728+0000","last_undegraded":"2023-09-28T00:22:59.706728+0000","last_fullsized":"2023-09-28T00:22:59.706728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688777+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:22:59.688777+0000","last_peered":"2023-09-28T00:22:59.688777+0000","last_clean":"2023-09-28T00:22:59.688777+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:22:59.688777+0000","last_undegraded":"2023-09-28T00:22:59.688777+0000","last_fullsized":"2023-09-28T00:22:59.688777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721092+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721092+0000","last_peered":"2023-09-28T00:23:03.721092+0000","last_clean":"2023-09-28T00:23:03.721092+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721092+0000","last_undegraded":"2023-09-28T00:23:03.721092+0000","last_fullsized":"2023-09-28T00:23:03.721092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691498+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:00.691498+0000","last_peered":"2023-09-28T00:23:00.691498+0000","last_clean":"2023-09-28T00:23:00.691498+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:00.691498+0000","last_undegraded":"2023-09-28T00:23:00.691498+0000","last_fullsized":"2023-09-28T00:23:00.691498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709340+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.709340+0000","last_peered":"2023-09-28T00:23:02.709340+0000","last_clean":"2023-09-28T00:23:02.709340+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.709340+0000","last_undegraded":"2023-09-28T00:23:02.709340+0000","last_fullsized":"2023-09-28T00:23:02.709340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.204904+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:22:59.204904+0000","last_peered":"2023-09-28T00:22:59.204904+0000","last_clean":"2023-09-28T00:22:59.204904+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:22:59.204904+0000","last_undegraded":"2023-09-28T00:22:59.204904+0000","last_fullsized":"2023-09-28T00:22:59.204904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188769+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.188769+0000","last_peered":"2023-09-28T00:23:02.188769+0000","last_clean":"2023-09-28T00:23:02.188769+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.188769+0000","last_undegraded":"2023-09-28T00:23:02.188769+0000","last_fullsized":"2023-09-28T00:23:02.188769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.711174+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:02.711174+0000","last_peered":"2023-09-28T00:23:02.711174+0000","last_clean":"2023-09-28T00:23:02.711174+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:02.711174+0000","last_undegraded":"2023-09-28T00:23:02.711174+0000","last_fullsized":"2023-09-28T00:23:02.711174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719585+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.719585+0000","last_peered":"2023-09-28T00:22:59.719585+0000","last_clean":"2023-09-28T00:22:59.719585+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.719585+0000","last_undegraded":"2023-09-28T00:22:59.719585+0000","last_fullsized":"2023-09-28T00:22:59.719585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.717499+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:03.717499+0000","last_peered":"2023-09-28T00:23:03.717499+0000","last_clean":"2023-09-28T00:23:03.717499+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:03.717499+0000","last_undegraded":"2023-09-28T00:23:03.717499+0000","last_fullsized":"2023-09-28T00:23:03.717499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709640+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:02.709640+0000","last_peered":"2023-09-28T00:23:02.709640+0000","last_clean":"2023-09-28T00:23:02.709640+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:02.709640+0000","last_undegraded":"2023-09-28T00:23:02.709640+0000","last_fullsized":"2023-09-28T00:23:02.709640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.718028+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:03.718028+0000","last_peered":"2023-09-28T00:23:03.718028+0000","last_clean":"2023-09-28T00:23:03.718028+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:03.718028+0000","last_undegraded":"2023-09-28T00:23:03.718028+0000","last_fullsized":"2023-09-28T00:23:03.718028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717417+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:22:59.717417+0000","last_peered":"2023-09-28T00:22:59.717417+0000","last_clean":"2023-09-28T00:22:59.717417+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:22:59.717417+0000","last_undegraded":"2023-09-28T00:22:59.717417+0000","last_fullsized":"2023-09-28T00:22:59.717417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.705603+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:22:59.705603+0000","last_peered":"2023-09-28T00:22:59.705603+0000","last_clean":"2023-09-28T00:22:59.705603+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:22:59.705603+0000","last_undegraded":"2023-09-28T00:22:59.705603+0000","last_fullsized":"2023-09-28T00:22:59.705603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707608+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:22:59.707608+0000","last_peered":"2023-09-28T00:22:59.707608+0000","last_clean":"2023-09-28T00:22:59.707608+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:22:59.707608+0000","last_undegraded":"2023-09-28T00:22:59.707608+0000","last_fullsized":"2023-09-28T00:22:59.707608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714574+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.714574+0000","last_peered":"2023-09-28T00:22:59.714574+0000","last_clean":"2023-09-28T00:22:59.714574+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.714574+0000","last_undegraded":"2023-09-28T00:22:59.714574+0000","last_fullsized":"2023-09-28T00:22:59.714574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713912+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:22:59.713912+0000","last_peered":"2023-09-28T00:22:59.713912+0000","last_clean":"2023-09-28T00:22:59.713912+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:22:59.713912+0000","last_undegraded":"2023-09-28T00:22:59.713912+0000","last_fullsized":"2023-09-28T00:22:59.713912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720227+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.720227+0000","last_peered":"2023-09-28T00:22:59.720227+0000","last_clean":"2023-09-28T00:22:59.720227+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.720227+0000","last_undegraded":"2023-09-28T00:22:59.720227+0000","last_fullsized":"2023-09-28T00:22:59.720227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.716741+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:03.716741+0000","last_peered":"2023-09-28T00:23:03.716741+0000","last_clean":"2023-09-28T00:23:03.716741+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:03.716741+0000","last_undegraded":"2023-09-28T00:23:03.716741+0000","last_fullsized":"2023-09-28T00:23:03.716741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189044+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:02.189044+0000","last_peered":"2023-09-28T00:23:02.189044+0000","last_clean":"2023-09-28T00:23:02.189044+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:02.189044+0000","last_undegraded":"2023-09-28T00:23:02.189044+0000","last_fullsized":"2023-09-28T00:23:02.189044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709289+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:02.709289+0000","last_peered":"2023-09-28T00:23:02.709289+0000","last_clean":"2023-09-28T00:23:02.709289+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:02.709289+0000","last_undegraded":"2023-09-28T00:23:02.709289+0000","last_fullsized":"2023-09-28T00:23:02.709289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720447+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.720447+0000","last_peered":"2023-09-28T00:22:59.720447+0000","last_clean":"2023-09-28T00:22:59.720447+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.720447+0000","last_undegraded":"2023-09-28T00:22:59.720447+0000","last_fullsized":"2023-09-28T00:22:59.720447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.205390+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:22:59.205390+0000","last_peered":"2023-09-28T00:22:59.205390+0000","last_clean":"2023-09-28T00:22:59.205390+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:22:59.205390+0000","last_undegraded":"2023-09-28T00:22:59.205390+0000","last_fullsized":"2023-09-28T00:22:59.205390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.717740+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.717740+0000","last_peered":"2023-09-28T00:23:03.717740+0000","last_clean":"2023-09-28T00:23:03.717740+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.717740+0000","last_undegraded":"2023-09-28T00:23:03.717740+0000","last_fullsized":"2023-09-28T00:23:03.717740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.207874+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.207874+0000","last_peered":"2023-09-28T00:22:59.207874+0000","last_clean":"2023-09-28T00:22:59.207874+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.207874+0000","last_undegraded":"2023-09-28T00:22:59.207874+0000","last_fullsized":"2023-09-28T00:22:59.207874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189154+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:02.189154+0000","last_peered":"2023-09-28T00:23:02.189154+0000","last_clean":"2023-09-28T00:23:02.189154+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:02.189154+0000","last_undegraded":"2023-09-28T00:23:02.189154+0000","last_fullsized":"2023-09-28T00:23:02.189154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.718224+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.718224+0000","last_peered":"2023-09-28T00:23:03.718224+0000","last_clean":"2023-09-28T00:23:03.718224+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.718224+0000","last_undegraded":"2023-09-28T00:23:03.718224+0000","last_fullsized":"2023-09-28T00:23:03.718224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691102+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:22:59.691102+0000","last_peered":"2023-09-28T00:22:59.691102+0000","last_clean":"2023-09-28T00:22:59.691102+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:22:59.691102+0000","last_undegraded":"2023-09-28T00:22:59.691102+0000","last_fullsized":"2023-09-28T00:22:59.691102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708728+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:02.708728+0000","last_peered":"2023-09-28T00:23:02.708728+0000","last_clean":"2023-09-28T00:23:02.708728+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:02.708728+0000","last_undegraded":"2023-09-28T00:23:02.708728+0000","last_fullsized":"2023-09-28T00:23:02.708728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.714275+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:03.714275+0000","last_peered":"2023-09-28T00:23:03.714275+0000","last_clean":"2023-09-28T00:23:03.714275+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:03.714275+0000","last_undegraded":"2023-09-28T00:23:03.714275+0000","last_fullsized":"2023-09-28T00:23:03.714275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719323+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.719323+0000","last_peered":"2023-09-28T00:22:59.719323+0000","last_clean":"2023-09-28T00:22:59.719323+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.719323+0000","last_undegraded":"2023-09-28T00:22:59.719323+0000","last_fullsized":"2023-09-28T00:22:59.719323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706277+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:22:59.706277+0000","last_peered":"2023-09-28T00:22:59.706277+0000","last_clean":"2023-09-28T00:22:59.706277+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:22:59.706277+0000","last_undegraded":"2023-09-28T00:22:59.706277+0000","last_fullsized":"2023-09-28T00:22:59.706277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707218+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.707218+0000","last_peered":"2023-09-28T00:22:59.707218+0000","last_clean":"2023-09-28T00:22:59.707218+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.707218+0000","last_undegraded":"2023-09-28T00:22:59.707218+0000","last_fullsized":"2023-09-28T00:22:59.707218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719196+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:03.719196+0000","last_peered":"2023-09-28T00:23:03.719196+0000","last_clean":"2023-09-28T00:23:03.719196+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:03.719196+0000","last_undegraded":"2023-09-28T00:23:03.719196+0000","last_fullsized":"2023-09-28T00:23:03.719196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711509+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.711509+0000","last_peered":"2023-09-28T00:22:59.711509+0000","last_clean":"2023-09-28T00:22:59.711509+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.711509+0000","last_undegraded":"2023-09-28T00:22:59.711509+0000","last_fullsized":"2023-09-28T00:22:59.711509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.722349+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:03.722349+0000","last_peered":"2023-09-28T00:23:03.722349+0000","last_clean":"2023-09-28T00:23:03.722349+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:03.722349+0000","last_undegraded":"2023-09-28T00:23:03.722349+0000","last_fullsized":"2023-09-28T00:23:03.722349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709112+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.709112+0000","last_peered":"2023-09-28T00:22:59.709112+0000","last_clean":"2023-09-28T00:22:59.709112+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.709112+0000","last_undegraded":"2023-09-28T00:22:59.709112+0000","last_fullsized":"2023-09-28T00:22:59.709112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701662+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.701662+0000","last_peered":"2023-09-28T00:22:59.701662+0000","last_clean":"2023-09-28T00:22:59.701662+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.701662+0000","last_undegraded":"2023-09-28T00:22:59.701662+0000","last_fullsized":"2023-09-28T00:22:59.701662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4832,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12100,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359740,"statfs":{"total":96636764160,"available":96624373760,"internally_reserved":0,"allocated":258048,"data_stored":91522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13104,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94358736,"statfs":{"total":96636764160,"available":96623345664,"internally_reserved":0,"allocated":827392,"data_stored":673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12260,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359580,"statfs":{"total":96636764160,"available":96624209920,"internally_reserved":0,"allocated":290816,"data_stored":98987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12196,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359644,"statfs":{"total":96636764160,"available":96624275456,"internally_reserved":0,"allocated":290816,"data_stored":98489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":97181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":97291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9176,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362664,"statfs":{"total":96636764160,"available":96627367936,"internally_reserved":0,"allocated":868352,"data_stored":687751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":97383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:06.077 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.297+0000 7fe88a9ff700 1 Processor -- start 2023-09-28T00:23:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.297+0000 7fe88a9ff700 1 -- start start 2023-09-28T00:23:06.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.298+0000 7fe88a9ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe88406c230 0x7fe884153b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.298+0000 7fe88a9ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1b10 0x7fe884154040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.298+0000 7fe88a9ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe884153670 con 0x7fe8840c1740 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe88a9ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8840c43f0 con 0x7fe88406c230 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe88a9ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c2bc0 con 0x7fe8840c1b10 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe883fff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe8840c1740 0x7fe8840c24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58522/0 (socket says 172.21.15.53:58522) 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe883fff700 1 -- 172.21.15.53:0/3816808262 learned_addr learned my addr 172.21.15.53:0/3816808262 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe888f9c700 1 --2- 172.21.15.53:0/3816808262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1b10 0x7fe884154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe8837fe700 1 --2- 172.21.15.53:0/3816808262 >> v2:172.21.15.118:3300/0 conn(0x7fe88406c230 0x7fe884153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe882ffd700 1 -- 172.21.15.53:0/3816808262 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126371805 0 0) 0x7fe884153670 con 0x7fe8840c1740 2023-09-28T00:23:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe882ffd700 1 -- 172.21.15.53:0/3816808262 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe86c003570 con 0x7fe8840c1740 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe888f9c700 1 -- 172.21.15.53:0/3816808262 >> v2:172.21.15.118:3300/0 conn(0x7fe88406c230 msgr2=0x7fe884153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe888f9c700 1 --2- 172.21.15.53:0/3816808262 >> v2:172.21.15.118:3300/0 conn(0x7fe88406c230 0x7fe884153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe888f9c700 1 -- 172.21.15.53:0/3816808262 >> v1:172.21.15.53:6789/0 conn(0x7fe8840c1740 legacy=0x7fe8840c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.299+0000 7fe888f9c700 1 -- 172.21.15.53:0/3816808262 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840c3890 con 0x7fe8840c1b10 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe888f9c700 1 --2- 172.21.15.53:0/3816808262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1b10 0x7fe884154040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009e60 tx=0x7fe87c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cafe94d0f3c15820 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe882ffd700 1 -- 172.21.15.53:0/3816808262 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00e070 con 0x7fe8840c1b10 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe882ffd700 1 -- 172.21.15.53:0/3816808262 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c00bab0 con 0x7fe8840c1b10 2023-09-28T00:23:06.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe882ffd700 1 -- 172.21.15.53:0/3816808262 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00be50 con 0x7fe8840c1b10 2023-09-28T00:23:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3816808262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1b10 msgr2=0x7fe884154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3816808262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1b10 0x7fe884154040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009e60 tx=0x7fe87c009780 comp rx=0 tx=0).stop 2023-09-28T00:23:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3816808262 shutdown_connections 2023-09-28T00:23:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3816808262 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1b10 0x7fe884154040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3816808262 >> v2:172.21.15.118:3300/0 conn(0x7fe88406c230 0x7fe884153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3816808262 >> 172.21.15.53:0/3816808262 conn(0x7fe8840c7b40 msgr2=0x7fe8840c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3816808262 shutdown_connections 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.300+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3816808262 wait complete. 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.302+0000 7fe88a9ff700 1 Processor -- start 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.302+0000 7fe88a9ff700 1 -- start start 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe88a9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88406c230 0x7fe884165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe88a9ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1740 0x7fe88414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe88a9ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 0x7fe88406f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe88a9ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840b9d10 con 0x7fe8840c1b10 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe88a9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884165740 con 0x7fe88406c230 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe88a9ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840ba360 con 0x7fe8840c1740 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe888f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 0x7fe88406f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe888f9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 0x7fe88406f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60556/0 (socket says 172.21.15.53:60556) 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe888f9c700 1 -- 172.21.15.53:0/3473003700 learned_addr learned my addr 172.21.15.53:0/3473003700 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe883fff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88406c230 0x7fe884165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.303+0000 7fe8837fe700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1740 0x7fe88414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe888f9c700 1 -- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1740 msgr2=0x7fe88414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe888f9c700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1740 0x7fe88414af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe888f9c700 1 -- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88406c230 msgr2=0x7fe884165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe888f9c700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88406c230 0x7fe884165bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe888f9c700 1 -- 172.21.15.53:0/3473003700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c009a20 con 0x7fe8840c1b10 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe883fff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88406c230 0x7fe884165bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:06.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe888f9c700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 0x7fe88406f370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b610 tx=0x7fe87c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:06.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c007000 con 0x7fe8840c1b10 2023-09-28T00:23:06.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840ba640 con 0x7fe8840c1b10 2023-09-28T00:23:06.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c012d80 con 0x7fe8840c1b10 2023-09-28T00:23:06.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c026640 con 0x7fe8840c1b10 2023-09-28T00:23:06.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.304+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8840bac00 con 0x7fe8840c1b10 2023-09-28T00:23:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.305+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe884071830 con 0x7fe8840c1b10 2023-09-28T00:23:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.306+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe87c0269b0 con 0x7fe8840c1b10 2023-09-28T00:23:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.307+0000 7fe86bfff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe870067330 0x7fe8700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.307+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe87c0869e0 con 0x7fe8840c1b10 2023-09-28T00:23:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.307+0000 7fe883fff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe870067330 0x7fe8700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.308+0000 7fe883fff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe870067330 0x7fe8700697e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe874007fd0 tx=0x7fe874009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:06.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.311+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe87c053840 con 0x7fe8840c1b10 2023-09-28T00:23:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.511+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8840c3b50 con 0x7fe870067330 2023-09-28T00:23:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.520+0000 7fe86bfff700 1 -- 172.21.15.53:0/3473003700 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284825 (secure 0 0 0) 0x7fe8840c3b50 con 0x7fe870067330 2023-09-28T00:23:06.524 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe870067330 msgr2=0x7fe8700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe870067330 0x7fe8700697e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe874007fd0 tx=0x7fe874009040 comp rx=0 tx=0).stop 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 msgr2=0x7fe88406f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 0x7fe88406f370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b610 tx=0x7fe87c019000 comp rx=0 tx=0).stop 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 shutdown_connections 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe870067330 0x7fe8700697e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8840c1b10 0x7fe88406f370 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88406c230 0x7fe884165bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 --2- 172.21.15.53:0/3473003700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8840c1740 0x7fe88414af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 >> 172.21.15.53:0/3473003700 conn(0x7fe8840c7b40 msgr2=0x7fe884067d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:06.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 shutdown_connections 2023-09-28T00:23:06.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.524+0000 7fe88a9ff700 1 -- 172.21.15.53:0/3473003700 wait complete. 2023-09-28T00:23:06.528 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:06.541 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-09-28T00:23:05.102751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595200,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":268,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83008,"kb_used_data":3264,"kb_used_omap":0,"kb_used_meta":79680,"kb_avail":754891712,"statfs":{"total":773094113280,"available":773009113088,"internally_reserved":0,"allocated":3342336,"data_stored":1941842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81592320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4832,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001460"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708075+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.708075+0000","last_peered":"2023-09-28T00:22:59.708075+0000","last_clean":"2023-09-28T00:22:59.708075+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.708075+0000","last_undegraded":"2023-09-28T00:22:59.708075+0000","last_fullsized":"2023-09-28T00:22:59.708075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.702306+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.702306+0000","last_peered":"2023-09-28T00:22:59.702306+0000","last_clean":"2023-09-28T00:22:59.702306+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.702306+0000","last_undegraded":"2023-09-28T00:22:59.702306+0000","last_fullsized":"2023-09-28T00:22:59.702306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.693696+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.693696+0000","last_peered":"2023-09-28T00:22:59.693696+0000","last_clean":"2023-09-28T00:22:59.693696+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.693696+0000","last_undegraded":"2023-09-28T00:22:59.693696+0000","last_fullsized":"2023-09-28T00:22:59.693696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.705340+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.705340+0000","last_peered":"2023-09-28T00:22:59.705340+0000","last_clean":"2023-09-28T00:22:59.705340+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.705340+0000","last_undegraded":"2023-09-28T00:22:59.705340+0000","last_fullsized":"2023-09-28T00:22:59.705340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.716095+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.716095+0000","last_peered":"2023-09-28T00:22:59.716095+0000","last_clean":"2023-09-28T00:22:59.716095+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.716095+0000","last_undegraded":"2023-09-28T00:22:59.716095+0000","last_fullsized":"2023-09-28T00:22:59.716095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703608+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.703608+0000","last_peered":"2023-09-28T00:22:59.703608+0000","last_clean":"2023-09-28T00:22:59.703608+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.703608+0000","last_undegraded":"2023-09-28T00:22:59.703608+0000","last_fullsized":"2023-09-28T00:22:59.703608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.716293+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.716293+0000","last_peered":"2023-09-28T00:22:59.716293+0000","last_clean":"2023-09-28T00:22:59.716293+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.716293+0000","last_undegraded":"2023-09-28T00:22:59.716293+0000","last_fullsized":"2023-09-28T00:22:59.716293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706728+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.706728+0000","last_peered":"2023-09-28T00:22:59.706728+0000","last_clean":"2023-09-28T00:22:59.706728+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.706728+0000","last_undegraded":"2023-09-28T00:22:59.706728+0000","last_fullsized":"2023-09-28T00:22:59.706728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688777+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:22:59.688777+0000","last_peered":"2023-09-28T00:22:59.688777+0000","last_clean":"2023-09-28T00:22:59.688777+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:22:59.688777+0000","last_undegraded":"2023-09-28T00:22:59.688777+0000","last_fullsized":"2023-09-28T00:22:59.688777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721092+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721092+0000","last_peered":"2023-09-28T00:23:03.721092+0000","last_clean":"2023-09-28T00:23:03.721092+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721092+0000","last_undegraded":"2023-09-28T00:23:03.721092+0000","last_fullsized":"2023-09-28T00:23:03.721092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691498+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:00.691498+0000","last_peered":"2023-09-28T00:23:00.691498+0000","last_clean":"2023-09-28T00:23:00.691498+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:00.691498+0000","last_undegraded":"2023-09-28T00:23:00.691498+0000","last_fullsized":"2023-09-28T00:23:00.691498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709340+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.709340+0000","last_peered":"2023-09-28T00:23:02.709340+0000","last_clean":"2023-09-28T00:23:02.709340+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.709340+0000","last_undegraded":"2023-09-28T00:23:02.709340+0000","last_fullsized":"2023-09-28T00:23:02.709340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.204904+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:22:59.204904+0000","last_peered":"2023-09-28T00:22:59.204904+0000","last_clean":"2023-09-28T00:22:59.204904+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:22:59.204904+0000","last_undegraded":"2023-09-28T00:22:59.204904+0000","last_fullsized":"2023-09-28T00:22:59.204904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188769+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.188769+0000","last_peered":"2023-09-28T00:23:02.188769+0000","last_clean":"2023-09-28T00:23:02.188769+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.188769+0000","last_undegraded":"2023-09-28T00:23:02.188769+0000","last_fullsized":"2023-09-28T00:23:02.188769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.711174+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:02.711174+0000","last_peered":"2023-09-28T00:23:02.711174+0000","last_clean":"2023-09-28T00:23:02.711174+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:02.711174+0000","last_undegraded":"2023-09-28T00:23:02.711174+0000","last_fullsized":"2023-09-28T00:23:02.711174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719585+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.719585+0000","last_peered":"2023-09-28T00:22:59.719585+0000","last_clean":"2023-09-28T00:22:59.719585+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.719585+0000","last_undegraded":"2023-09-28T00:22:59.719585+0000","last_fullsized":"2023-09-28T00:22:59.719585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.717499+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:03.717499+0000","last_peered":"2023-09-28T00:23:03.717499+0000","last_clean":"2023-09-28T00:23:03.717499+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:03.717499+0000","last_undegraded":"2023-09-28T00:23:03.717499+0000","last_fullsized":"2023-09-28T00:23:03.717499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709640+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:02.709640+0000","last_peered":"2023-09-28T00:23:02.709640+0000","last_clean":"2023-09-28T00:23:02.709640+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:02.709640+0000","last_undegraded":"2023-09-28T00:23:02.709640+0000","last_fullsized":"2023-09-28T00:23:02.709640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.718028+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:03.718028+0000","last_peered":"2023-09-28T00:23:03.718028+0000","last_clean":"2023-09-28T00:23:03.718028+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:03.718028+0000","last_undegraded":"2023-09-28T00:23:03.718028+0000","last_fullsized":"2023-09-28T00:23:03.718028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717417+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:22:59.717417+0000","last_peered":"2023-09-28T00:22:59.717417+0000","last_clean":"2023-09-28T00:22:59.717417+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:22:59.717417+0000","last_undegraded":"2023-09-28T00:22:59.717417+0000","last_fullsized":"2023-09-28T00:22:59.717417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.705603+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:22:59.705603+0000","last_peered":"2023-09-28T00:22:59.705603+0000","last_clean":"2023-09-28T00:22:59.705603+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:22:59.705603+0000","last_undegraded":"2023-09-28T00:22:59.705603+0000","last_fullsized":"2023-09-28T00:22:59.705603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707608+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:22:59.707608+0000","last_peered":"2023-09-28T00:22:59.707608+0000","last_clean":"2023-09-28T00:22:59.707608+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:22:59.707608+0000","last_undegraded":"2023-09-28T00:22:59.707608+0000","last_fullsized":"2023-09-28T00:22:59.707608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714574+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.714574+0000","last_peered":"2023-09-28T00:22:59.714574+0000","last_clean":"2023-09-28T00:22:59.714574+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.714574+0000","last_undegraded":"2023-09-28T00:22:59.714574+0000","last_fullsized":"2023-09-28T00:22:59.714574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713912+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:22:59.713912+0000","last_peered":"2023-09-28T00:22:59.713912+0000","last_clean":"2023-09-28T00:22:59.713912+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:22:59.713912+0000","last_undegraded":"2023-09-28T00:22:59.713912+0000","last_fullsized":"2023-09-28T00:22:59.713912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720227+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.720227+0000","last_peered":"2023-09-28T00:22:59.720227+0000","last_clean":"2023-09-28T00:22:59.720227+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.720227+0000","last_undegraded":"2023-09-28T00:22:59.720227+0000","last_fullsized":"2023-09-28T00:22:59.720227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.716741+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:03.716741+0000","last_peered":"2023-09-28T00:23:03.716741+0000","last_clean":"2023-09-28T00:23:03.716741+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:03.716741+0000","last_undegraded":"2023-09-28T00:23:03.716741+0000","last_fullsized":"2023-09-28T00:23:03.716741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189044+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:02.189044+0000","last_peered":"2023-09-28T00:23:02.189044+0000","last_clean":"2023-09-28T00:23:02.189044+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:02.189044+0000","last_undegraded":"2023-09-28T00:23:02.189044+0000","last_fullsized":"2023-09-28T00:23:02.189044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709289+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:02.709289+0000","last_peered":"2023-09-28T00:23:02.709289+0000","last_clean":"2023-09-28T00:23:02.709289+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:02.709289+0000","last_undegraded":"2023-09-28T00:23:02.709289+0000","last_fullsized":"2023-09-28T00:23:02.709289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720447+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.720447+0000","last_peered":"2023-09-28T00:22:59.720447+0000","last_clean":"2023-09-28T00:22:59.720447+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.720447+0000","last_undegraded":"2023-09-28T00:22:59.720447+0000","last_fullsized":"2023-09-28T00:22:59.720447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.205390+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:22:59.205390+0000","last_peered":"2023-09-28T00:22:59.205390+0000","last_clean":"2023-09-28T00:22:59.205390+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:22:59.205390+0000","last_undegraded":"2023-09-28T00:22:59.205390+0000","last_fullsized":"2023-09-28T00:22:59.205390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.717740+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.717740+0000","last_peered":"2023-09-28T00:23:03.717740+0000","last_clean":"2023-09-28T00:23:03.717740+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.717740+0000","last_undegraded":"2023-09-28T00:23:03.717740+0000","last_fullsized":"2023-09-28T00:23:03.717740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.207874+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.207874+0000","last_peered":"2023-09-28T00:22:59.207874+0000","last_clean":"2023-09-28T00:22:59.207874+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.207874+0000","last_undegraded":"2023-09-28T00:22:59.207874+0000","last_fullsized":"2023-09-28T00:22:59.207874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189154+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:02.189154+0000","last_peered":"2023-09-28T00:23:02.189154+0000","last_clean":"2023-09-28T00:23:02.189154+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:02.189154+0000","last_undegraded":"2023-09-28T00:23:02.189154+0000","last_fullsized":"2023-09-28T00:23:02.189154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.718224+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.718224+0000","last_peered":"2023-09-28T00:23:03.718224+0000","last_clean":"2023-09-28T00:23:03.718224+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.718224+0000","last_undegraded":"2023-09-28T00:23:03.718224+0000","last_fullsized":"2023-09-28T00:23:03.718224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691102+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:22:59.691102+0000","last_peered":"2023-09-28T00:22:59.691102+0000","last_clean":"2023-09-28T00:22:59.691102+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:22:59.691102+0000","last_undegraded":"2023-09-28T00:22:59.691102+0000","last_fullsized":"2023-09-28T00:22:59.691102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708728+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:02.708728+0000","last_peered":"2023-09-28T00:23:02.708728+0000","last_clean":"2023-09-28T00:23:02.708728+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:02.708728+0000","last_undegraded":"2023-09-28T00:23:02.708728+0000","last_fullsized":"2023-09-28T00:23:02.708728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.714275+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:03.714275+0000","last_peered":"2023-09-28T00:23:03.714275+0000","last_clean":"2023-09-28T00:23:03.714275+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:03.714275+0000","last_undegraded":"2023-09-28T00:23:03.714275+0000","last_fullsized":"2023-09-28T00:23:03.714275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719323+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.719323+0000","last_peered":"2023-09-28T00:22:59.719323+0000","last_clean":"2023-09-28T00:22:59.719323+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.719323+0000","last_undegraded":"2023-09-28T00:22:59.719323+0000","last_fullsized":"2023-09-28T00:22:59.719323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706277+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:22:59.706277+0000","last_peered":"2023-09-28T00:22:59.706277+0000","last_clean":"2023-09-28T00:22:59.706277+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:22:59.706277+0000","last_undegraded":"2023-09-28T00:22:59.706277+0000","last_fullsized":"2023-09-28T00:22:59.706277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707218+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.707218+0000","last_peered":"2023-09-28T00:22:59.707218+0000","last_clean":"2023-09-28T00:22:59.707218+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.707218+0000","last_undegraded":"2023-09-28T00:22:59.707218+0000","last_fullsized":"2023-09-28T00:22:59.707218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719196+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:03.719196+0000","last_peered":"2023-09-28T00:23:03.719196+0000","last_clean":"2023-09-28T00:23:03.719196+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:03.719196+0000","last_undegraded":"2023-09-28T00:23:03.719196+0000","last_fullsized":"2023-09-28T00:23:03.719196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711509+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.711509+0000","last_peered":"2023-09-28T00:22:59.711509+0000","last_clean":"2023-09-28T00:22:59.711509+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.711509+0000","last_undegraded":"2023-09-28T00:22:59.711509+0000","last_fullsized":"2023-09-28T00:22:59.711509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.722349+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:03.722349+0000","last_peered":"2023-09-28T00:23:03.722349+0000","last_clean":"2023-09-28T00:23:03.722349+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:03.722349+0000","last_undegraded":"2023-09-28T00:23:03.722349+0000","last_fullsized":"2023-09-28T00:23:03.722349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709112+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.709112+0000","last_peered":"2023-09-28T00:22:59.709112+0000","last_clean":"2023-09-28T00:22:59.709112+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.709112+0000","last_undegraded":"2023-09-28T00:22:59.709112+0000","last_fullsized":"2023-09-28T00:22:59.709112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701662+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.701662+0000","last_peered":"2023-09-28T00:22:59.701662+0000","last_clean":"2023-09-28T00:22:59.701662+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.701662+0000","last_undegraded":"2023-09-28T00:22:59.701662+0000","last_fullsized":"2023-09-28T00:22:59.701662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4832,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12100,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359740,"statfs":{"total":96636764160,"available":96624373760,"internally_reserved":0,"allocated":258048,"data_stored":91522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13104,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94358736,"statfs":{"total":96636764160,"available":96623345664,"internally_reserved":0,"allocated":827392,"data_stored":673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12260,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359580,"statfs":{"total":96636764160,"available":96624209920,"internally_reserved":0,"allocated":290816,"data_stored":98987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12196,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359644,"statfs":{"total":96636764160,"available":96624275456,"internally_reserved":0,"allocated":290816,"data_stored":98489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":97181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":97291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9176,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362664,"statfs":{"total":96636764160,"available":96627367936,"internally_reserved":0,"allocated":868352,"data_stored":687751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":97383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:06.547 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-28T00:23:06.547 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-28T00:23:06.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-28T00:23:06.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-28T00:23:06.548 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-28T00:23:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.770+0000 7fd2d279d700 1 Processor -- start 2023-09-28T00:23:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.770+0000 7fd2d279d700 1 -- start start 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d279d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd2cc155d00 0x7fd2cc0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d279d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d279d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2cc1560d0 0x7fd2cc0c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d279d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0c6c10 con 0x7fd2cc1560d0 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d279d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0c52b0 con 0x7fd2cc155d00 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d279d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0c5d20 con 0x7fd2cc156680 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2cc1560d0 0x7fd2cc0c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2cc1560d0 0x7fd2cc0c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60568/0 (socket says 172.21.15.53:60568) 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 -- 172.21.15.53:0/1072273114 learned_addr learned my addr 172.21.15.53:0/1072273114 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d0f9a700 1 --2- 172.21.15.53:0/1072273114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d179b700 1 --2- 172.21.15.53:0/1072273114 >> v2:172.21.15.118:3300/0 conn(0x7fd2cc155d00 0x7fd2cc0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 -- 172.21.15.53:0/1072273114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 msgr2=0x7fd2cc0c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 --2- 172.21.15.53:0/1072273114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 -- 172.21.15.53:0/1072273114 >> v2:172.21.15.118:3300/0 conn(0x7fd2cc155d00 msgr2=0x7fd2cc0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 --2- 172.21.15.53:0/1072273114 >> v2:172.21.15.118:3300/0 conn(0x7fd2cc155d00 0x7fd2cc0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.772+0000 7fd2d1f9c700 1 -- 172.21.15.53:0/1072273114 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0c6000 con 0x7fd2cc1560d0 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.773+0000 7fd2d1f9c700 1 --2- 172.21.15.53:0/1072273114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c09f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc06d180 tx=0x7fd2c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed43eeddd8e26baf server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.773+0000 7fd2c3fff700 1 -- 172.21.15.53:0/1072273114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400e070 con 0x7fd2cc1560d0 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.773+0000 7fd2c3fff700 1 -- 172.21.15.53:0/1072273114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400ba00 con 0x7fd2cc1560d0 2023-09-28T00:23:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.773+0000 7fd2c3fff700 1 -- 172.21.15.53:0/1072273114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40092e0 con 0x7fd2cc1560d0 2023-09-28T00:23:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.773+0000 7fd2d279d700 1 -- 172.21.15.53:0/1072273114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 msgr2=0x7fd2cc0c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.773+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1072273114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c09f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc06d180 tx=0x7fd2c4009840 comp rx=0 tx=0).stop 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 -- 172.21.15.53:0/1072273114 shutdown_connections 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1072273114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c09f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1072273114 >> v2:172.21.15.118:3300/0 conn(0x7fd2cc155d00 0x7fd2cc0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1072273114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 -- 172.21.15.53:0/1072273114 >> 172.21.15.53:0/1072273114 conn(0x7fd2cc067630 msgr2=0x7fd2cc067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 -- 172.21.15.53:0/1072273114 shutdown_connections 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.774+0000 7fd2d279d700 1 -- 172.21.15.53:0/1072273114 wait complete. 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.775+0000 7fd2d279d700 1 Processor -- start 2023-09-28T00:23:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.775+0000 7fd2d279d700 1 -- start start 2023-09-28T00:23:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d279d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc155d00 0x7fd2cc147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d279d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d279d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d279d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc166100 con 0x7fd2cc1560d0 2023-09-28T00:23:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d279d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc151600 con 0x7fd2cc155d00 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d279d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc151170 con 0x7fd2cc156680 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d0f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d0f9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60580/0 (socket says 172.21.15.53:60580) 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d0f9a700 1 -- 172.21.15.53:0/1356328174 learned_addr learned my addr 172.21.15.53:0/1356328174 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d179b700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc155d00 0x7fd2cc147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.776+0000 7fd2d1f9c700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d0f9a700 1 -- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 msgr2=0x7fd2cc0c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d0f9a700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d0f9a700 1 -- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc155d00 msgr2=0x7fd2cc147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d0f9a700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc155d00 0x7fd2cc147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d0f9a700 1 -- 172.21.15.53:0/1356328174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4009ae0 con 0x7fd2cc1560d0 2023-09-28T00:23:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d0f9a700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c1fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00e900 tx=0x7fd2bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc013680 con 0x7fd2cc1560d0 2023-09-28T00:23:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc013800 con 0x7fd2cc1560d0 2023-09-28T00:23:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc013bc0 con 0x7fd2cc1560d0 2023-09-28T00:23:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc150560 con 0x7fd2cc1560d0 2023-09-28T00:23:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.777+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc150b20 con 0x7fd2cc1560d0 2023-09-28T00:23:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.778+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc04c3c0 con 0x7fd2cc1560d0 2023-09-28T00:23:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.779+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd2bc0123d0 con 0x7fd2cc1560d0 2023-09-28T00:23:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.780+0000 7fd2c17fa700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd2b0067330 0x7fd2b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.780+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd2bc084d70 con 0x7fd2cc1560d0 2023-09-28T00:23:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.780+0000 7fd2d179b700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd2b0067330 0x7fd2b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.781+0000 7fd2d179b700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd2b0067330 0x7fd2b00697e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009db0 tx=0x7fd2c80091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:06.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:06.784+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd2bc051bd0 con 0x7fd2cc1560d0 2023-09-28T00:23:07.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.041+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd2cc1512b0 con 0x7fd2cc1560d0 2023-09-28T00:23:07.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.044+0000 7fd2c17fa700 1 -- 172.21.15.53:0/1356328174 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164228 (secure 0 0 0) 0x7fd2bc0551f0 con 0x7fd2cc1560d0 2023-09-28T00:23:07.046 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:07.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd2b0067330 msgr2=0x7fd2b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd2b0067330 0x7fd2b00697e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009db0 tx=0x7fd2c80091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 msgr2=0x7fd2cc0c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c1fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00e900 tx=0x7fd2bc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 shutdown_connections 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd2b0067330 0x7fd2b00697e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2cc156680 0x7fd2cc0c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc155d00 0x7fd2cc147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 --2- 172.21.15.53:0/1356328174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2cc1560d0 0x7fd2cc0c1fd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 >> 172.21.15.53:0/1356328174 conn(0x7fd2cc067630 msgr2=0x7fd2cc14c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 shutdown_connections 2023-09-28T00:23:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.047+0000 7fd2d279d700 1 -- 172.21.15.53:0/1356328174 wait complete. 2023-09-28T00:23:07.064 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":120136},{"type":"v1","addr":"172.21.15.118:6833","nonce":120136}]},"active_addr":"172.21.15.118:6833/120136","active_change":"2023-09-28T00:22:39.091604+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4115,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":720823285}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":2099289488}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":2083062414}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1252391251}]}]} 2023-09-28T00:23:07.068 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-28T00:23:07.068 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-28T00:23:07.069 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:07.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.256+0000 7efe9639d700 1 Processor -- start 2023-09-28T00:23:07.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.256+0000 7efe9639d700 1 -- start start 2023-09-28T00:23:07.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9639d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe900add50 0x7efe901560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9639d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900ccaa0 con 0x7efe900cc560 2023-09-28T00:23:07.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9639d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900ae830 con 0x7efe90069ca0 2023-09-28T00:23:07.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9639d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe90068c00 con 0x7efe900add50 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9539b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe900add50 0x7efe901560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9539b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe900add50 0x7efe901560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60586/0 (socket says 172.21.15.53:60586) 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe94b9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efe900cc560 0x7efe900ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58536/0 (socket says 172.21.15.53:58536) 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.257+0000 7efe9539b700 1 -- 172.21.15.53:0/1144018299 learned_addr learned my addr 172.21.15.53:0/1144018299 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe9539b700 1 -- 172.21.15.53:0/1144018299 >> v1:172.21.15.118:6789/0 conn(0x7efe90069ca0 legacy=0x7efe9014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe9539b700 1 -- 172.21.15.53:0/1144018299 >> v1:172.21.15.53:6789/0 conn(0x7efe900cc560 legacy=0x7efe900ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe9539b700 1 -- 172.21.15.53:0/1144018299 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90068ee0 con 0x7efe900add50 2023-09-28T00:23:07.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe87fff700 1 -- 172.21.15.53:0/1144018299 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127501941 0 0) 0x7efe900ccaa0 con 0x7efe900cc560 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe9539b700 1 --2- 172.21.15.53:0/1144018299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe900add50 0x7efe901560f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0099b0 tx=0x7efe8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9099d996887bf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe87fff700 1 -- 172.21.15.53:0/1144018299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00b8f0 con 0x7efe900add50 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe87fff700 1 -- 172.21.15.53:0/1144018299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c00ba50 con 0x7efe900add50 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.258+0000 7efe87fff700 1 -- 172.21.15.53:0/1144018299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00bdf0 con 0x7efe900add50 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 -- 172.21.15.53:0/1144018299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe900add50 msgr2=0x7efe901560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 --2- 172.21.15.53:0/1144018299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe900add50 0x7efe901560f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0099b0 tx=0x7efe8c009250 comp rx=0 tx=0).stop 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 -- 172.21.15.53:0/1144018299 shutdown_connections 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 --2- 172.21.15.53:0/1144018299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe900add50 0x7efe901560f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 -- 172.21.15.53:0/1144018299 >> 172.21.15.53:0/1144018299 conn(0x7efe9006f7f0 msgr2=0x7efe900cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:07.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 -- 172.21.15.53:0/1144018299 shutdown_connections 2023-09-28T00:23:07.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.259+0000 7efe9639d700 1 -- 172.21.15.53:0/1144018299 wait complete. 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.260+0000 7efe9639d700 1 Processor -- start 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.261+0000 7efe9639d700 1 -- start start 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.261+0000 7efe9639d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 0x7efe901579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9639d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe900add50 0x7efe90155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9639d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe900cc560 0x7efe90158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9639d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90156c50 con 0x7efe90069ca0 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9639d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900c60a0 con 0x7efe900cc560 2023-09-28T00:23:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9639d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe90153b80 con 0x7efe900add50 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 0x7efe901579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 0x7efe901579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60592/0 (socket says 172.21.15.53:60592) 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 -- 172.21.15.53:0/1377964072 learned_addr learned my addr 172.21.15.53:0/1377964072 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe94b9a700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe900add50 0x7efe90155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe95b9c700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe900cc560 0x7efe90158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 -- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe900add50 msgr2=0x7efe90155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe900add50 0x7efe90155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 -- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe900cc560 msgr2=0x7efe90158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe900cc560 0x7efe90158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 -- 172.21.15.53:0/1377964072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0094f0 con 0x7efe90069ca0 2023-09-28T00:23:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.262+0000 7efe9539b700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 0x7efe901579a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe90088f60 tx=0x7efe8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.263+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c01f070 con 0x7efe90069ca0 2023-09-28T00:23:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.263+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c011c40 con 0x7efe90069ca0 2023-09-28T00:23:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.263+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe900c62f0 con 0x7efe90069ca0 2023-09-28T00:23:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.263+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c025420 con 0x7efe90069ca0 2023-09-28T00:23:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.263+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe901568e0 con 0x7efe90069ca0 2023-09-28T00:23:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.264+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe90156f30 con 0x7efe90069ca0 2023-09-28T00:23:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.265+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efe8c023070 con 0x7efe90069ca0 2023-09-28T00:23:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.266+0000 7efe857fa700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe74067330 0x7efe740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.266+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe8c086280 con 0x7efe90069ca0 2023-09-28T00:23:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.266+0000 7efe94b9a700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe74067330 0x7efe740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.266+0000 7efe94b9a700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe74067330 0x7efe740697e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe80007fd0 tx=0x7efe80007db0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.270+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efe8c0530e0 con 0x7efe90069ca0 2023-09-28T00:23:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.472+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe9004c3c0 con 0x7efe90069ca0 2023-09-28T00:23:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.473+0000 7efe857fa700 1 -- 172.21.15.53:0/1377964072 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7efe8c056700 con 0x7efe90069ca0 2023-09-28T00:23:07.473 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:07.473 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:07.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe74067330 msgr2=0x7efe740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe74067330 0x7efe740697e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe80007fd0 tx=0x7efe80007db0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 msgr2=0x7efe901579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 0x7efe901579a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe90088f60 tx=0x7efe8c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 shutdown_connections 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe74067330 0x7efe740697e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe900cc560 0x7efe90158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe90069ca0 0x7efe901579a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 --2- 172.21.15.53:0/1377964072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe900add50 0x7efe90155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.475+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 >> 172.21.15.53:0/1377964072 conn(0x7efe9006f7f0 msgr2=0x7efe900c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.476+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 shutdown_connections 2023-09-28T00:23:07.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.476+0000 7efe9639d700 1 -- 172.21.15.53:0/1377964072 wait complete. 2023-09-28T00:23:07.493 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-28T00:23:07.494 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:07.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.680+0000 7f45abfff700 1 Processor -- start 2023-09-28T00:23:07.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.680+0000 7f45abfff700 1 -- start start 2023-09-28T00:23:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45abfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f45ac0c8bf0 0x7f45ac06c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45abfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c8fc0 0x7f45ac0c5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45abfff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac0684e0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45abfff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac1553f0 con 0x7f45ac0c8bf0 2023-09-28T00:23:07.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45abfff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac1555e0 con 0x7f45ac0c8fc0 2023-09-28T00:23:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45aaffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f45ac0c8bf0 0x7f45ac06c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c8fc0 0x7f45ac0c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45aa7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f45ac0c3e10 0x7f45ac0c2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54274/0 (socket says 172.21.15.53:54274) 2023-09-28T00:23:07.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.681+0000 7f45aa7fc700 1 -- 172.21.15.53:0/2482113592 learned_addr learned my addr 172.21.15.53:0/2482113592 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:07.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45aaffd700 1 -- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c8fc0 msgr2=0x7f45ac0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:07.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45aaffd700 1 --2- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c8fc0 0x7f45ac0c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45aaffd700 1 -- 172.21.15.53:0/2482113592 >> v1:172.21.15.118:6789/0 conn(0x7f45ac0c3e10 legacy=0x7f45ac0c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45aaffd700 1 -- 172.21.15.53:0/2482113592 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac1558c0 con 0x7f45ac0c8bf0 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45a9ffb700 1 -- 172.21.15.53:0/2482113592 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403586394 0 0) 0x7f45ac0684e0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45ab7fe700 1 --2- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c8fc0 0x7f45ac0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45aaffd700 1 --2- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac06c2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098e0 tx=0x7f459c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83011ee2f12326e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45a9ffb700 1 -- 172.21.15.53:0/2482113592 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00b6d0 con 0x7f45ac0c8bf0 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45a9ffb700 1 -- 172.21.15.53:0/2482113592 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00b830 con 0x7f45ac0c8bf0 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.682+0000 7f45a9ffb700 1 -- 172.21.15.53:0/2482113592 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00bbd0 con 0x7f45ac0c8bf0 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 -- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8bf0 msgr2=0x7f45ac06c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 --2- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac06c2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098e0 tx=0x7f459c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 -- 172.21.15.53:0/2482113592 shutdown_connections 2023-09-28T00:23:07.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 --2- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c8fc0 0x7f45ac0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 --2- 172.21.15.53:0/2482113592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac06c2e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 -- 172.21.15.53:0/2482113592 >> 172.21.15.53:0/2482113592 conn(0x7f45ac06a990 msgr2=0x7f45ac06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:07.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 -- 172.21.15.53:0/2482113592 shutdown_connections 2023-09-28T00:23:07.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.683+0000 7f45abfff700 1 -- 172.21.15.53:0/2482113592 wait complete. 2023-09-28T00:23:07.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.684+0000 7f45abfff700 1 Processor -- start 2023-09-28T00:23:07.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 -- start start 2023-09-28T00:23:07.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 0x7f45ac169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8fc0 0x7f45ac1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac1689f0 con 0x7f45ac0c8bf0 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c0200 con 0x7f45ac0c8fc0 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.685+0000 7f45abfff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c04c0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aa7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 0x7f45ac169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 0x7f45ac169400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41018/0 (socket says 172.21.15.53:41018) 2023-09-28T00:23:07.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 -- 172.21.15.53:0/1781030033 learned_addr learned my addr 172.21.15.53:0/1781030033 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aa7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac0c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60598/0 (socket says 172.21.15.53:60598) 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45ab7fe700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8fc0 0x7f45ac1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 -- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8fc0 msgr2=0x7f45ac1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8fc0 0x7f45ac1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 -- 172.21.15.53:0/1781030033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45ac0c8bf0 msgr2=0x7f45ac0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 -- 172.21.15.53:0/1781030033 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009a20 con 0x7f45ac0c3e10 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.686+0000 7f45aaffd700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 0x7f45ac169400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0c9800 tx=0x7f459c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.687+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00bbb0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.687+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c011420 con 0x7f45ac0c3e10 2023-09-28T00:23:07.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.687+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0117a0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.687+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c009420 con 0x7f45ac0c3e10 2023-09-28T00:23:07.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.687+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac1685f0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.688+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac169940 con 0x7f45ac0c3e10 2023-09-28T00:23:07.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.689+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f459c011b50 con 0x7f45ac0c3e10 2023-09-28T00:23:07.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.690+0000 7f4592ffd700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4598067360 0x7f4598069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:07.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.690+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f459c0864b0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.690+0000 7f45aa7fc700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4598067360 0x7f4598069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:07.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.691+0000 7f45aa7fc700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4598067360 0x7f4598069810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45ac15acc0 tx=0x7f45a0007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:07.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.695+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f459c0533d0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.900+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45ac1687e0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.902+0000 7f4592ffd700 1 -- 172.21.15.53:0/1781030033 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f459c0569f0 con 0x7f45ac0c3e10 2023-09-28T00:23:07.902 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:07.902 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4598067360 msgr2=0x7f4598069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4598067360 0x7f4598069810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45ac15acc0 tx=0x7f45a0007d30 comp rx=0 tx=0).stop 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 msgr2=0x7f45ac169400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 0x7f45ac169400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0c9800 tx=0x7f459c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 shutdown_connections 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4598067360 0x7f4598069810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45ac0c3e10 0x7f45ac169400 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45ac0c8fc0 0x7f45ac1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 --2- 172.21.15.53:0/1781030033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45ac0c8bf0 0x7f45ac0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 >> 172.21.15.53:0/1781030033 conn(0x7f45ac06a990 msgr2=0x7f45ac15ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 shutdown_connections 2023-09-28T00:23:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:07.904+0000 7f45abfff700 1 -- 172.21.15.53:0/1781030033 wait complete. 2023-09-28T00:23:07.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-28T00:23:07.923 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-28T00:23:07.923 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-28T00:23:07.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-28T00:23:07.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-28T00:23:07.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-28T00:23:07.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-28T00:23:07.926 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-28T00:23:08.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.264+0000 7ff86f59e700 1 Processor -- start 2023-09-28T00:23:08.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.264+0000 7ff86f59e700 1 -- start start 2023-09-28T00:23:08.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.263+0000 7fbff259d700 1 Processor -- start 2023-09-28T00:23:08.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.263+0000 7fbff259d700 1 -- start start 2023-09-28T00:23:08.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff259d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbfec0c4aa0 0x7fbfec165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff259d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec0bfc70 con 0x7fbfec0c2e30 2023-09-28T00:23:08.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff259d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec06e850 con 0x7fbfec0c3200 2023-09-28T00:23:08.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff259d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec166c20 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff0d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbfec0c4aa0 0x7fbfec165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7ff86f59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a5c0 0x7ff8700c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff159b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbfec0c2e30 0x7fbfec0bf560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58548/0 (socket says 172.21.15.53:58548) 2023-09-28T00:23:08.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7ff86f59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff87006a990 0x7ff8701533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7ff86f59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87006f2d0 con 0x7ff8700ad7d0 2023-09-28T00:23:08.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7ff86f59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87006b580 con 0x7ff87006a990 2023-09-28T00:23:08.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7ff86f59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87015a750 con 0x7ff87006a5c0 2023-09-28T00:23:08.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.265+0000 7fbff159b700 1 -- 172.21.15.53:0/3070158095 learned_addr learned my addr 172.21.15.53:0/3070158095 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7fbfe3fff700 1 -- 172.21.15.53:0/3070158095 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270788123 0 0) 0x7fbfe8001110 con 0x7fbfec0c2e30 2023-09-28T00:23:08.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.266+0000 7fbfe3fff700 1 -- 172.21.15.53:0/3070158095 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd8007980 con 0x7fbfec0c2e30 2023-09-28T00:23:08.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86ed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff87006a990 0x7ff8701533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86ed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff87006a990 0x7ff8701533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34544/0 (socket says 172.21.15.53:34544) 2023-09-28T00:23:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86ed9d700 1 -- 172.21.15.53:0/499828396 learned_addr learned my addr 172.21.15.53:0/499828396 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7fbff0d9a700 1 -- 172.21.15.53:0/3070158095 >> v1:172.21.15.118:6789/0 conn(0x7fbfec0c3200 legacy=0x7fbfec1660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7fbff0d9a700 1 -- 172.21.15.53:0/3070158095 >> v1:172.21.15.53:6789/0 conn(0x7fbfec0c2e30 legacy=0x7fbfec0bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7fbff0d9a700 1 -- 172.21.15.53:0/3070158095 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec06f0f0 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86ed9d700 1 -- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a5c0 msgr2=0x7ff8700c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86e59c700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a5c0 0x7ff8700c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86ed9d700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a5c0 0x7ff8700c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7ff86ed9d700 1 -- 172.21.15.53:0/499828396 >> v1:172.21.15.118:6789/0 conn(0x7ff8700ad7d0 legacy=0x7ff87006ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.267+0000 7fbff0d9a700 1 --2- 172.21.15.53:0/3070158095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec165b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4008e40 tx=0x7fbfe4008780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578b07b1f321afd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.268+0000 7fbfe3fff700 1 -- 172.21.15.53:0/3070158095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4017d80 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.268+0000 7fbfe3fff700 1 -- 172.21.15.53:0/3070158095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe400b970 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.268+0000 7fbfe3fff700 1 -- 172.21.15.53:0/3070158095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400bd10 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.269+0000 7ff86ed9d700 1 -- 172.21.15.53:0/499828396 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700add80 con 0x7ff87006a990 2023-09-28T00:23:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.269+0000 7efe84f9d700 1 Processor -- start 2023-09-28T00:23:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.269+0000 7efe84f9d700 1 -- start start 2023-09-28T00:23:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.269+0000 7ff86e59c700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a5c0 0x7ff8700c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.269+0000 7fbff259d700 1 -- 172.21.15.53:0/3070158095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 msgr2=0x7fbfec165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.269+0000 7fbff259d700 1 --2- 172.21.15.53:0/3070158095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec165b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4008e40 tx=0x7fbfe4008780 comp rx=0 tx=0).stop 2023-09-28T00:23:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.270+0000 7fbff259d700 1 -- 172.21.15.53:0/3070158095 shutdown_connections 2023-09-28T00:23:08.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.270+0000 7ff86ed9d700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87006a990 0x7ff8701533d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8600099b0 tx=0x7ff860009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dd2f40931dcde7f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.270+0000 7fbff259d700 1 --2- 172.21.15.53:0/3070158095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec165b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.270+0000 7fbff259d700 1 -- 172.21.15.53:0/3070158095 >> 172.21.15.53:0/3070158095 conn(0x7fbfec067630 msgr2=0x7fbfec067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.270+0000 7fbff259d700 1 -- 172.21.15.53:0/3070158095 shutdown_connections 2023-09-28T00:23:08.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.270+0000 7fbff259d700 1 -- 172.21.15.53:0/3070158095 wait complete. 2023-09-28T00:23:08.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.271+0000 7ff86d59a700 1 -- 172.21.15.53:0/499828396 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000b8f0 con 0x7ff87006a990 2023-09-28T00:23:08.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.271+0000 7ff86d59a700 1 -- 172.21.15.53:0/499828396 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86000ba50 con 0x7ff87006a990 2023-09-28T00:23:08.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.271+0000 7ff86d59a700 1 -- 172.21.15.53:0/499828396 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000bdf0 con 0x7ff87006a990 2023-09-28T00:23:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.271+0000 7efe84f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe80159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.271+0000 7efe84f9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 0x7efe800cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.272+0000 7efe7f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efe800c0e10 0x7efe8013e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58550/0 (socket says 172.21.15.53:58550) 2023-09-28T00:23:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.272+0000 7fbff259d700 1 Processor -- start 2023-09-28T00:23:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.272+0000 7ff86f59e700 1 -- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87006a990 msgr2=0x7ff8701533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.272+0000 7ff86f59e700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87006a990 0x7ff8701533d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff8600099b0 tx=0x7ff860009250 comp rx=0 tx=0).stop 2023-09-28T00:23:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe7ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 0x7efe800cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.272+0000 7efe7effd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe80159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe7effd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe80159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41038/0 (socket says 172.21.15.53:41038) 2023-09-28T00:23:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe7ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 0x7efe800cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60608/0 (socket says 172.21.15.53:60608) 2023-09-28T00:23:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7fbff259d700 1 -- start start 2023-09-28T00:23:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7ff86f59e700 1 -- 172.21.15.53:0/499828396 shutdown_connections 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7ff86f59e700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff87006a990 0x7ff8701533d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7ff86f59e700 1 --2- 172.21.15.53:0/499828396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a5c0 0x7ff8700c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7ff86f59e700 1 -- 172.21.15.53:0/499828396 >> 172.21.15.53:0/499828396 conn(0x7ff8700c4c50 msgr2=0x7ff8700c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7ff86f59e700 1 -- 172.21.15.53:0/499828396 shutdown_connections 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7ff86f59e700 1 -- 172.21.15.53:0/499828396 wait complete. 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe84f9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe80156040 con 0x7efe800c0e10 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe84f9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800c6cf0 con 0x7efe8013ed20 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe84f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800c6730 con 0x7efe800c11e0 2023-09-28T00:23:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.273+0000 7efe7f7fe700 1 -- 172.21.15.53:0/3465176175 learned_addr learned my addr 172.21.15.53:0/3465176175 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.274+0000 7efe7effd700 1 -- 172.21.15.53:0/3465176175 >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 msgr2=0x7efe800cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.274+0000 7f3a8a39d700 1 Processor -- start 2023-09-28T00:23:08.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.274+0000 7efe7e7fc700 1 -- 172.21.15.53:0/3465176175 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39648912 0 0) 0x7efe80156040 con 0x7efe800c0e10 2023-09-28T00:23:08.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.274+0000 7efe7effd700 1 --2- 172.21.15.53:0/3465176175 >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 0x7efe800cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.275+0000 7efe7effd700 1 -- 172.21.15.53:0/3465176175 >> v1:172.21.15.53:6789/0 conn(0x7efe800c0e10 legacy=0x7efe8013e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.275+0000 7fbff259d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfec0c2e30 0x7fbfec15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.275+0000 7efe7effd700 1 -- 172.21.15.53:0/3465176175 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800c6a10 con 0x7efe800c11e0 2023-09-28T00:23:08.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.275+0000 7fbff259d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfec0c3200 0x7fbfec1723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.275+0000 7efe7ffff700 1 --2- 172.21.15.53:0/3465176175 >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 0x7efe800cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff259d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.274+0000 7f3a8a39d700 1 -- start start 2023-09-28T00:23:08.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff259d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0c5720 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff259d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0c6870 con 0x7fbfec0c3200 2023-09-28T00:23:08.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff259d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0bff90 con 0x7fbfec0c2e30 2023-09-28T00:23:08.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7efe7effd700 1 --2- 172.21.15.53:0/3465176175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe80159840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe74009910 tx=0x7efe740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7851f5423833b063 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff159b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfec0c2e30 0x7fbfec15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7ff86f59e700 1 Processor -- start 2023-09-28T00:23:08.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff1d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff1d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec1551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60624/0 (socket says 172.21.15.53:60624) 2023-09-28T00:23:08.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff1d9c700 1 -- 172.21.15.53:0/2507149333 learned_addr learned my addr 172.21.15.53:0/2507149333 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7fbff0d9a700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfec0c3200 0x7fbfec1723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7f3a8a39d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a840c11e0 0x7f3a84159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7f3a8a39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8413ed20 0x7f3a840cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.276+0000 7ff86f59e700 1 -- start start 2023-09-28T00:23:08.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a8a39d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84156040 con 0x7f3a840c0e10 2023-09-28T00:23:08.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a8a39d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a840c6cf0 con 0x7f3a840c11e0 2023-09-28T00:23:08.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a8a39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840c6730 con 0x7f3a8413ed20 2023-09-28T00:23:08.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7efe7e7fc700 1 -- 172.21.15.53:0/3465176175 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400b640 con 0x7efe800c11e0 2023-09-28T00:23:08.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7efe7e7fc700 1 -- 172.21.15.53:0/3465176175 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7400b7a0 con 0x7efe800c11e0 2023-09-28T00:23:08.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a8939b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3a840c0e10 0x7f3a8413e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54284/0 (socket says 172.21.15.53:54284) 2023-09-28T00:23:08.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a8939b700 1 -- 172.21.15.53:0/3026139944 learned_addr learned my addr 172.21.15.53:0/3026139944 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7fbff1d9c700 1 -- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfec0c2e30 msgr2=0x7fbfec15f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7fbff1d9c700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfec0c2e30 0x7fbfec15f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7fbff1d9c700 1 -- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfec0c3200 msgr2=0x7fbfec1723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7fbff1d9c700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfec0c3200 0x7fbfec1723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7fbff1d9c700 1 -- 172.21.15.53:0/2507149333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4008a20 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8413ed20 0x7f3a840cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798755677 0 0) 0x7f3a84156040 con 0x7f3a840c0e10 2023-09-28T00:23:08.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a70003570 con 0x7f3a840c0e10 2023-09-28T00:23:08.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f89a95ff700 1 Processor -- start 2023-09-28T00:23:08.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.277+0000 7efe7e7fc700 1 -- 172.21.15.53:0/3465176175 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7400b640 con 0x7efe800c11e0 2023-09-28T00:23:08.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7efe84f9d700 1 -- 172.21.15.53:0/3465176175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 msgr2=0x7efe80159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7efe84f9d700 1 --2- 172.21.15.53:0/3465176175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe80159840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe74009910 tx=0x7efe740091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7ff86f59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006a5c0 0x7ff87016d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7fbff1d9c700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec1551c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c560 tx=0x7fbfdc007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196760558 0 0) 0x7f3a70003570 con 0x7f3a840c0e10 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8413ed20 msgr2=0x7f3a840cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/3026139944 >> v2:172.21.15.118:3300/0 conn(0x7f3a840c11e0 0x7f3a84159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8413ed20 0x7f3a840cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 >> v2:172.21.15.118:3300/0 conn(0x7f3a840c11e0 msgr2=0x7f3a84159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 --2- 172.21.15.53:0/3026139944 >> v2:172.21.15.118:3300/0 conn(0x7f3a840c11e0 0x7f3a84159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc011590 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840c6a10 con 0x7f3a840c0e10 2023-09-28T00:23:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 107228552 0 0) 0x7f3a80001470 con 0x7f3a840c0e10 2023-09-28T00:23:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f89a95ff700 1 -- start start 2023-09-28T00:23:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 >> v1:172.21.15.118:6789/0 conn(0x7f3a840c0e10 legacy=0x7f3a8413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70003ae0 0x7f3a70003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a70004810 0x7f3a70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a70005210 0x7f3a7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840c6cf0 con 0x7f3a70003ae0 2023-09-28T00:23:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840c6730 con 0x7f3a70004810 2023-09-28T00:23:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7000c100 con 0x7f3a70005210 2023-09-28T00:23:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7fbff259d700 1 -- 172.21.15.53:0/2507149333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec168d80 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7efe84f9d700 1 -- 172.21.15.53:0/3465176175 shutdown_connections 2023-09-28T00:23:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7efe84f9d700 1 --2- 172.21.15.53:0/3465176175 >> v2:172.21.15.53:3300/0 conn(0x7efe8013ed20 0x7efe800cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7efe84f9d700 1 --2- 172.21.15.53:0/3465176175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe80159840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7efe84f9d700 1 -- 172.21.15.53:0/3465176175 >> 172.21.15.53:0/3465176175 conn(0x7efe8006f830 msgr2=0x7efe800cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.278+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8413ed20 0x7f3a840cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/3026139944 >> v2:172.21.15.118:3300/0 conn(0x7f3a840c11e0 0x7f3a84159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a70005210 0x7f3a7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006a5c0 0x7ff87016d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006a5c0 0x7ff87016d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60640/0 (socket says 172.21.15.53:60640) 2023-09-28T00:23:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86e59c700 1 -- 172.21.15.53:0/3630527307 learned_addr learned my addr 172.21.15.53:0/3630527307 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86f59e700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a990 0x7ff8701519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86f59e700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8700ad7d0 0x7ff87014b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7efe84f9d700 1 -- 172.21.15.53:0/3465176175 shutdown_connections 2023-09-28T00:23:08.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86dd9b700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a990 0x7ff8701519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86ed9d700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8700ad7d0 0x7ff87014b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8701693e0 con 0x7ff87006a5c0 2023-09-28T00:23:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87016d860 con 0x7ff8700ad7d0 2023-09-28T00:23:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87016a1c0 con 0x7ff87006a990 2023-09-28T00:23:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7f3a8939b700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70003ae0 0x7f3a70003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a70004810 0x7f3a70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7ff86ed9d700 1 -- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a990 msgr2=0x7ff8701519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7ff86ed9d700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff87006a990 0x7ff8701519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7ff86ed9d700 1 -- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006a5c0 msgr2=0x7ff87016d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7ff86ed9d700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006a5c0 0x7ff87016d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.280+0000 7ff86ed9d700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600094f0 con 0x7ff8700ad7d0 2023-09-28T00:23:08.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7ff86e59c700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006a5c0 0x7ff87016d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f3a89b9c700 1 -- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a70004810 msgr2=0x7f3a70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f89a95ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89a40c7b90 0x7f89a41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7ff86ed9d700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8700ad7d0 0x7ff87014b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff87006b730 tx=0x7ff860017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a70004810 0x7f3a70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f89a95ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c7f60 0x7f89a40c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f3a89b9c700 1 -- 172.21.15.53:0/3026139944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70003ae0 msgr2=0x7f3a70003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86001a630 con 0x7ff8700ad7d0 2023-09-28T00:23:08.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.279+0000 7efe84f9d700 1 -- 172.21.15.53:0/3465176175 wait complete. 2023-09-28T00:23:08.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7efe84f9d700 1 Processor -- start 2023-09-28T00:23:08.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70003ae0 0x7f3a70003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f3a89b9c700 1 -- 172.21.15.53:0/3026139944 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840c6a10 con 0x7f3a70005210 2023-09-28T00:23:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f89a95ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f89a414f710 0x7f89a414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f89a95ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a40c8990 con 0x7f89a414f710 2023-09-28T00:23:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f89a95ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a4159d00 con 0x7f89a40c7b90 2023-09-28T00:23:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a70004810 0x7f3a70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.281+0000 7f89a95ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40c6e60 con 0x7f89a40c7f60 2023-09-28T00:23:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89a40c7b90 0x7f89a41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a70005210 0x7f3a7000ba60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a8413f0f0 tx=0x7f3a740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58710f62eb8f7cef server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89a40c7b90 0x7f89a41597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34576/0 (socket says 172.21.15.53:34576) 2023-09-28T00:23:08.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 -- 172.21.15.53:0/2891258721 learned_addr learned my addr 172.21.15.53:0/2891258721 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400e6e0 con 0x7f3a70005210 2023-09-28T00:23:08.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 -- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c7f60 msgr2=0x7f89a40c6920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400e840 con 0x7f3a70005210 2023-09-28T00:23:08.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7f3a7bfff700 1 -- 172.21.15.53:0/3026139944 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400ebc0 con 0x7f3a70005210 2023-09-28T00:23:08.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 --2- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c7f60 0x7f89a40c6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 -- 172.21.15.53:0/2891258721 >> v2:172.21.15.53:3300/0 conn(0x7f89a414f710 msgr2=0x7f89a414fb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7fbff259d700 1 -- 172.21.15.53:0/2507149333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec0c0250 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 --2- 172.21.15.53:0/2891258721 >> v2:172.21.15.53:3300/0 conn(0x7f89a414f710 0x7f89a414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7f89a2ffd700 1 -- 172.21.15.53:0/2891258721 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40c8ba0 con 0x7f89a40c7b90 2023-09-28T00:23:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7f89a2ffd700 1 --2- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 0x7f89a41597c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89a4088d30 tx=0x7f8994009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=473c39ce68feb0dc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.282+0000 7efe84f9d700 1 -- start start 2023-09-28T00:23:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7efe84f9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe800c0e10 0x7efe80165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8701695f0 con 0x7ff8700ad7d0 2023-09-28T00:23:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0116f0 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f3a8a39d700 1 -- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a70005210 msgr2=0x7f3a7000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f3a8a39d700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a70005210 0x7f3a7000ba60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a8413f0f0 tx=0x7f3a740091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f89a27fc700 1 -- 172.21.15.53:0/2891258721 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400e070 con 0x7f89a40c7b90 2023-09-28T00:23:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f3a89b9c700 1 -- 172.21.15.53:0/3026139944 reap_dead start 2023-09-28T00:23:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f89a27fc700 1 -- 172.21.15.53:0/2891258721 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400bae0 con 0x7f89a40c7b90 2023-09-28T00:23:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f89a27fc700 1 -- 172.21.15.53:0/2891258721 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940092e0 con 0x7f89a40c7b90 2023-09-28T00:23:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7efe7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe800c0e10 0x7efe80165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7efe7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe800c0e10 0x7efe80165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60672/0 (socket says 172.21.15.53:60672) 2023-09-28T00:23:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f3a8a39d700 1 -- 172.21.15.53:0/3026139944 shutdown_connections 2023-09-28T00:23:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f3a8a39d700 1 -- 172.21.15.53:0/3026139944 >> 172.21.15.53:0/3026139944 conn(0x7f3a8406f830 msgr2=0x7f3a840cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7efe7f7fe700 1 -- 172.21.15.53:0/809476022 learned_addr learned my addr 172.21.15.53:0/809476022 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f3a8939b700 1 --2- 172.21.15.53:0/3026139944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70003ae0 0x7f3a70003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870169b70 con 0x7ff8700ad7d0 2023-09-28T00:23:08.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86001a7d0 con 0x7ff8700ad7d0 2023-09-28T00:23:08.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7efe84f9d700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe8014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.283+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86001ab90 con 0x7ff8700ad7d0 2023-09-28T00:23:08.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7efe84f9d700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8013ed20 0x7efe801386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc011a90 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbfdc01b3b0 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7efe7ffff700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8013ed20 0x7efe801386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80165880 con 0x7efe800c0e10 2023-09-28T00:23:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80161e40 con 0x7efe8013ed20 2023-09-28T00:23:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8014f300 con 0x7efe800c11e0 2023-09-28T00:23:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 -- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 msgr2=0x7f89a41597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 --2- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 0x7f89a41597c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89a4088d30 tx=0x7f8994009840 comp rx=0 tx=0).stop 2023-09-28T00:23:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 -- 172.21.15.53:0/2891258721 shutdown_connections 2023-09-28T00:23:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 --2- 172.21.15.53:0/2891258721 >> v2:172.21.15.53:3300/0 conn(0x7f89a414f710 0x7f89a414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 --2- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 0x7f89a41597c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7f3a8a39d700 1 -- 172.21.15.53:0/3026139944 shutdown_connections 2023-09-28T00:23:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 --2- 172.21.15.53:0/2891258721 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a40c7f60 0x7f89a40c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7fbff259d700 1 -- 172.21.15.53:0/2507149333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfcc000fd0 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7efe7f7fe700 1 -- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 msgr2=0x7efe8014edc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-28T00:23:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7efe7f7fe700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe800c11e0 0x7efe8014edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7efe7f7fe700 1 -- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8013ed20 msgr2=0x7efe801386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7fbfe17fa700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbfd00674b0 0x7fbfd0069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff8600233e0 con 0x7ff8700ad7d0 2023-09-28T00:23:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7efe7f7fe700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe8013ed20 0x7efe801386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbfdc083e00 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7efe7f7fe700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78014600 con 0x7efe800c0e10 2023-09-28T00:23:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7efe7f7fe700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe800c0e10 0x7efe80165340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe7000c8a0 tx=0x7efe70007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f71dbfff700 1 Processor -- start 2023-09-28T00:23:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.284+0000 7f71dbfff700 1 -- start start 2023-09-28T00:23:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7f71dbfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71dc0c2eb0 0x7f71dc06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7f71dbfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0bea70 con 0x7f71dc0c3280 2023-09-28T00:23:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7f71dbfff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc06e000 con 0x7f71dc15a830 2023-09-28T00:23:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7f71dbfff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0c2660 con 0x7f71dc0c2eb0 2023-09-28T00:23:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7f71da7fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f71dc0c3280 0x7f71dc15a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58562/0 (socket says 172.21.15.53:58562) 2023-09-28T00:23:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7f71da7fc700 1 -- 172.21.15.53:0/2678540304 learned_addr learned my addr 172.21.15.53:0/2678540304 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7fbfe17fa700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fbfd006fb70 0x7fbfd0071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700059f0 con 0x7efe800c0e10 2023-09-28T00:23:08.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70005b50 con 0x7efe800c0e10 2023-09-28T00:23:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700070f0 con 0x7efe800c0e10 2023-09-28T00:23:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe74009420 con 0x7efe800c0e10 2023-09-28T00:23:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7f3a8a39d700 1 -- 172.21.15.53:0/3026139944 wait complete. 2023-09-28T00:23:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 --> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfd0072630 con 0x7fbfd006fb70 2023-09-28T00:23:08.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 -- 172.21.15.53:0/2891258721 >> 172.21.15.53:0/2891258721 conn(0x7f89a406ed60 msgr2=0x7f89a406f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.285+0000 7f89a95ff700 1 -- 172.21.15.53:0/2891258721 shutdown_connections 2023-09-28T00:23:08.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfdc001140 con 0x7fbfec0c4aa0 2023-09-28T00:23:08.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7f89a95ff700 1 -- 172.21.15.53:0/2891258721 wait complete. 2023-09-28T00:23:08.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7f3a8a39d700 1 Processor -- start 2023-09-28T00:23:08.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7f71d9ffb700 1 -- 172.21.15.53:0/2678540304 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114779729 0 0) 0x7f71dc0bea70 con 0x7f71dc0c3280 2023-09-28T00:23:08.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7f71d9ffb700 1 -- 172.21.15.53:0/2678540304 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c4003570 con 0x7f71dc0c3280 2023-09-28T00:23:08.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7fbff159b700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbfd00674b0 0x7fbfd0069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.286+0000 7fb56a1ff700 1 Processor -- start 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.287+0000 7fb56a1ff700 1 -- start start 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7fb56a1ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb55c0dc660 0x7fb55c0e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7fb56a1ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c006e30 con 0x7fb55c045320 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7fb56a1ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c005fc0 con 0x7fb55c0456f0 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7fb56a1ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c045ac0 con 0x7fb55c0dc660 2023-09-28T00:23:08.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7f3a8a39d700 1 -- start start 2023-09-28T00:23:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fb562ffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb55c0456f0 0x7fb55c0dbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54310/0 (socket says 172.21.15.53:54310) 2023-09-28T00:23:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7ff85e7fc700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff850067480 0x7ff850069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7f71daffd700 1 --2- 172.21.15.53:0/2678540304 >> v2:172.21.15.118:3300/0 conn(0x7f71dc0c2eb0 0x7f71dc06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fb562ffd700 1 -- 172.21.15.53:0/3938369707 learned_addr learned my addr 172.21.15.53:0/3938369707 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fb563fff700 1 --2- 172.21.15.53:0/3938369707 >> v2:172.21.15.118:3300/0 conn(0x7fb55c0dc660 0x7fb55c0e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7ff86e59c700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff850067480 0x7ff850069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff860086800 con 0x7ff8700ad7d0 2023-09-28T00:23:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.288+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe800ca1c0 con 0x7efe800c0e10 2023-09-28T00:23:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.289+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe60000fd0 con 0x7efe800c0e10 2023-09-28T00:23:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff87004c3c0 con 0x7ff8700ad7d0 2023-09-28T00:23:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fb5627fc700 1 -- 172.21.15.53:0/3938369707 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271776718 0 0) 0x7fb55c005fc0 con 0x7fb55c0456f0 2023-09-28T00:23:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fb5627fc700 1 -- 172.21.15.53:0/3938369707 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb554003570 con 0x7fb55c0456f0 2023-09-28T00:23:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7ff85e7fc700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7ff85006fcb0 0x7ff8500720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff850072770 con 0x7ff85006fcb0 2023-09-28T00:23:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7f3a8a39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70005210 0x7f3a84150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7f3a8a39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8415b390 0x7f3a8415b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7f3a8a39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8415a140 0x7f3a8415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7f3a8a39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a841528d0 con 0x7f3a70005210 2023-09-28T00:23:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7f3a8a39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84152fd0 con 0x7f3a8415a140 2023-09-28T00:23:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7f3a8a39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8413a3d0 con 0x7f3a8415b390 2023-09-28T00:23:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff860009370 con 0x7ff8700ad7d0 2023-09-28T00:23:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fbff0d9a700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fbfd006fb70 0x7fbfd0071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fbff159b700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbfd00674b0 0x7fbfd0069960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80058d0 tx=0x7fbfe8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8415b390 0x7f3a8415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8415b390 0x7f3a8415b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41074/0 (socket says 172.21.15.53:41074) 2023-09-28T00:23:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 -- 172.21.15.53:0/127345738 learned_addr learned my addr 172.21.15.53:0/127345738 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.290+0000 7fe3f699d700 1 Processor -- start 2023-09-28T00:23:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7fe3f699d700 1 -- start start 2023-09-28T00:23:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8415a140 0x7f3a8415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7ff86dd9b700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7ff85006fcb0 0x7ff8500720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7fb563fff700 1 -- 172.21.15.53:0/3938369707 >> v1:172.21.15.118:6789/0 conn(0x7fb55c0456f0 legacy=0x7fb55c0dbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7fb563fff700 1 -- 172.21.15.53:0/3938369707 >> v1:172.21.15.53:6789/0 conn(0x7fb55c045320 legacy=0x7fb55c007130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f71daffd700 1 -- 172.21.15.53:0/2678540304 >> v1:172.21.15.118:6789/0 conn(0x7f71dc15a830 legacy=0x7f71dc1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f71daffd700 1 -- 172.21.15.53:0/2678540304 >> v1:172.21.15.53:6789/0 conn(0x7f71dc0c3280 legacy=0x7f71dc15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f71d9ffb700 1 -- 172.21.15.53:0/2678540304 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017064289 0 0) 0x7f71dc06e000 con 0x7f71dc15a830 2023-09-28T00:23:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f71daffd700 1 -- 172.21.15.53:0/2678540304 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc159c90 con 0x7f71dc0c2eb0 2023-09-28T00:23:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7fb563fff700 1 -- 172.21.15.53:0/3938369707 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c006260 con 0x7fb55c0dc660 2023-09-28T00:23:08.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 -- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8415a140 msgr2=0x7f3a8415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8415a140 0x7f3a8415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 -- 172.21.15.53:0/127345738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70005210 msgr2=0x7f3a84150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a70005210 0x7f3a84150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f3a88b9a700 1 -- 172.21.15.53:0/127345738 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8413b570 con 0x7f3a8415b390 2023-09-28T00:23:08.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.291+0000 7f71daffd700 1 --2- 172.21.15.53:0/2678540304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c2eb0 0x7f71dc06dac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b802997d854e60b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7ff86e59c700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff850067480 0x7ff850069930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff864006fd0 tx=0x7ff864008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f3a88b9a700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8415b390 0x7f3a8415b800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00cf80 tx=0x7f3a7c007840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7fbff0d9a700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fbfd006fb70 0x7fbfd0071f80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7fb563fff700 1 --2- 172.21.15.53:0/3938369707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c0e2cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb564000eb0 tx=0x7fb564066740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee90bb3b85a9588b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011070 con 0x7f3a8415b390 2023-09-28T00:23:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c0153f0 con 0x7f3a8415b390 2023-09-28T00:23:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011070 con 0x7f3a8415b390 2023-09-28T00:23:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8413acb0 con 0x7f3a8415b390 2023-09-28T00:23:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f71d9ffb700 1 -- 172.21.15.53:0/2678540304 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00b640 con 0x7f71dc0c2eb0 2023-09-28T00:23:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f71d9ffb700 1 -- 172.21.15.53:0/2678540304 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00b7a0 con 0x7f71dc0c2eb0 2023-09-28T00:23:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f71d9ffb700 1 -- 172.21.15.53:0/2678540304 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00bb40 con 0x7f71dc0c2eb0 2023-09-28T00:23:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7ff86dd9b700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7ff85006fcb0 0x7ff8500720c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7fb5627fc700 1 -- 172.21.15.53:0/3938369707 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5500014b0 con 0x7fb55c0dc660 2023-09-28T00:23:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7fb5627fc700 1 -- 172.21.15.53:0/3938369707 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56408b070 con 0x7fb55c0dc660 2023-09-28T00:23:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7fb5627fc700 1 -- 172.21.15.53:0/3938369707 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640648c0 con 0x7fb55c0dc660 2023-09-28T00:23:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.292+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a840c85e0 con 0x7f3a8415b390 2023-09-28T00:23:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7f71dbfff700 1 -- 172.21.15.53:0/2678540304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c2eb0 msgr2=0x7f71dc06dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7f71dbfff700 1 --2- 172.21.15.53:0/2678540304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c2eb0 0x7f71dc06dac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7f71dbfff700 1 -- 172.21.15.53:0/2678540304 shutdown_connections 2023-09-28T00:23:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7f71dbfff700 1 --2- 172.21.15.53:0/2678540304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c2eb0 0x7f71dc06dac0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7f71dbfff700 1 -- 172.21.15.53:0/2678540304 >> 172.21.15.53:0/2678540304 conn(0x7f71dc067630 msgr2=0x7f71dc067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7fe3f699d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3f00ade00 0x7fe3f00c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7fe3f699d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7fb56a1ff700 1 -- 172.21.15.53:0/3938369707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 msgr2=0x7fb55c0e2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== osd.1 v2:172.21.15.53:6802/85092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbfd0072630 con 0x7fbfd006fb70 2023-09-28T00:23:08.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7fb56a1ff700 1 --2- 172.21.15.53:0/3938369707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c0e2cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb564000eb0 tx=0x7fb564066740 comp rx=0 tx=0).stop 2023-09-28T00:23:08.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== osd.0 v2:172.21.15.53:6800/85093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff850072770 con 0x7ff85006fcb0 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.293+0000 7fe3f519a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f519a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f006e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41090/0 (socket says 172.21.15.53:41090) 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f699d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3f00c27a0 0x7fe3f01535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f599b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3f00ade00 0x7fe3f00c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f599b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3f00ade00 0x7fe3f00c0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34624/0 (socket says 172.21.15.53:34624) 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f599b700 1 -- 172.21.15.53:0/3309012121 learned_addr learned my addr 172.21.15.53:0/3309012121 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00ad2d0 con 0x7fe3f00c27a0 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00c86e0 con 0x7fe3f00ade00 2023-09-28T00:23:08.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00c14e0 con 0x7fe3f00ae1d0 2023-09-28T00:23:08.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7f71dbfff700 1 -- 172.21.15.53:0/2678540304 shutdown_connections 2023-09-28T00:23:08.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7f71dbfff700 1 -- 172.21.15.53:0/2678540304 wait complete. 2023-09-28T00:23:08.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f619c700 1 --2- 172.21.15.53:0/3309012121 >> v2:172.21.15.53:3300/0 conn(0x7fe3f00c27a0 0x7fe3f01535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fb56a1ff700 1 -- 172.21.15.53:0/3938369707 shutdown_connections 2023-09-28T00:23:08.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fb56a1ff700 1 --2- 172.21.15.53:0/3938369707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c0e2cb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fb56a1ff700 1 -- 172.21.15.53:0/3938369707 >> 172.21.15.53:0/3938369707 conn(0x7fb55c00beb0 msgr2=0x7fb55c00c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fb56a1ff700 1 -- 172.21.15.53:0/3938369707 shutdown_connections 2023-09-28T00:23:08.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a8404c3c0 con 0x7f3a8415b390 2023-09-28T00:23:08.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.295+0000 7f89a95ff700 1 Processor -- start 2023-09-28T00:23:08.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fb56a1ff700 1 -- 172.21.15.53:0/3938369707 wait complete. 2023-09-28T00:23:08.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f519a700 1 -- 172.21.15.53:0/3309012121 >> v2:172.21.15.118:3300/0 conn(0x7fe3f00ade00 msgr2=0x7fe3f00c0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f519a700 1 --2- 172.21.15.53:0/3309012121 >> v2:172.21.15.118:3300/0 conn(0x7fe3f00ade00 0x7fe3f00c0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f519a700 1 -- 172.21.15.53:0/3309012121 >> v2:172.21.15.53:3300/0 conn(0x7fe3f00c27a0 msgr2=0x7fe3f01535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f519a700 1 --2- 172.21.15.53:0/3309012121 >> v2:172.21.15.53:3300/0 conn(0x7fe3f00c27a0 0x7fe3f01535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.294+0000 7fe3f519a700 1 -- 172.21.15.53:0/3309012121 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00c1fe0 con 0x7fe3f00ae1d0 2023-09-28T00:23:08.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.295+0000 7fe3f519a700 1 --2- 172.21.15.53:0/3309012121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f006e6c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009910 tx=0x7fe3e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b4e9c0c5e94413f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.295+0000 7fe3f4999700 1 -- 172.21.15.53:0/3309012121 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e000b870 con 0x7fe3f00ae1d0 2023-09-28T00:23:08.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.295+0000 7f89a95ff700 1 -- start start 2023-09-28T00:23:08.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.295+0000 7fe3f4999700 1 -- 172.21.15.53:0/3309012121 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000b9f0 con 0x7fe3f00ae1d0 2023-09-28T00:23:08.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.295+0000 7fe3f4999700 1 -- 172.21.15.53:0/3309012121 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e000bdb0 con 0x7fe3f00ae1d0 2023-09-28T00:23:08.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.296+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3a7c0157b0 con 0x7f3a8415b390 2023-09-28T00:23:08.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.296+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 msgr2=0x7fe3f006e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fb56a1ff700 1 Processor -- start 2023-09-28T00:23:08.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.296+0000 7fe3f699d700 1 --2- 172.21.15.53:0/3309012121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f006e6c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009910 tx=0x7fe3e00091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7f71dbfff700 1 Processor -- start 2023-09-28T00:23:08.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 shutdown_connections 2023-09-28T00:23:08.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 --2- 172.21.15.53:0/3309012121 >> v2:172.21.15.53:3300/0 conn(0x7fe3f00c27a0 0x7fe3f01535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 --2- 172.21.15.53:0/3309012121 >> v2:172.21.15.118:3300/0 conn(0x7fe3f00ade00 0x7fe3f00c0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 --2- 172.21.15.53:0/3309012121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f006e6c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 >> 172.21.15.53:0/3309012121 conn(0x7fe3f00cbdf0 msgr2=0x7fe3f00cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7f71dbfff700 1 -- start start 2023-09-28T00:23:08.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fb56a1ff700 1 -- start start 2023-09-28T00:23:08.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 shutdown_connections 2023-09-28T00:23:08.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7fe3f699d700 1 -- 172.21.15.53:0/3309012121 wait complete. 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7f89a95ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 0x7f89a4150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.297+0000 7f89a95ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a40c7f60 0x7f89a4168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a95ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a414f710 0x7f89a414a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a95ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4152ee0 con 0x7f89a40c7f60 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a95ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4152b40 con 0x7f89a40c7b90 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a95ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4151570 con 0x7f89a414f710 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f899a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a40c7f60 0x7f89a4168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a414f710 0x7f89a414a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a414f710 0x7f89a414a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41098/0 (socket says 172.21.15.53:41098) 2023-09-28T00:23:08.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f89a37fe700 1 -- 172.21.15.53:0/779838976 learned_addr learned my addr 172.21.15.53:0/779838976 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f3a797fa700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3a680673c0 0x7f3a68069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a7c0850a0 con 0x7f3a8415b390 2023-09-28T00:23:08.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f3a797fa700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f3a6806fb70 0x7f3a68071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 --> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a68072630 con 0x7f3a6806fb70 2023-09-28T00:23:08.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a7c051fa0 con 0x7f3a8415b390 2023-09-28T00:23:08.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c3280 0x7f71dc137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f3a6806fb70 0x7f3a68071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f3a8939b700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3a680673c0 0x7f3a68069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb56a1ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb55c045320 0x7fb55c0f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb56a1ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb55c0456f0 0x7fb55c047c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb56a1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c048150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb56a1ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c050780 con 0x7fb55c045320 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb56a1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c050f90 con 0x7fb55c0dc660 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb56a1ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c04fd40 con 0x7fb55c0456f0 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb562ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb55c0456f0 0x7fb55c047c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb562ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb55c0456f0 0x7fb55c047c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41112/0 (socket says 172.21.15.53:41112) 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb562ffd700 1 -- 172.21.15.53:0/2248015478 learned_addr learned my addr 172.21.15.53:0/2248015478 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71dc15a830 0x7f71dc0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71dc13b190 0x7f71dc1400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f71dbfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1383a0 con 0x7f71dc13b190 2023-09-28T00:23:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f71dbfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc13aa20 con 0x7f71dc0c3280 2023-09-28T00:23:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f71dbfff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc13ad00 con 0x7f71dc15a830 2023-09-28T00:23:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb5637fe700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb55c045320 0x7fb55c0f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7fb563fff700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c048150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.299+0000 7f89a2ffd700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 0x7f89a4150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f899a7fc700 1 -- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a414f710 msgr2=0x7f89a414a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f899a7fc700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89a414f710 0x7f89a414a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f899a7fc700 1 -- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 msgr2=0x7f89a4150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f899a7fc700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40c7b90 0x7f89a4150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb562ffd700 1 -- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 msgr2=0x7fb55c048150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f899a7fc700 1 -- 172.21.15.53:0/779838976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009ae0 con 0x7f89a40c7f60 2023-09-28T00:23:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71dc15a830 0x7f71dc0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71dc15a830 0x7f71dc0c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41116/0 (socket says 172.21.15.53:41116) 2023-09-28T00:23:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 -- 172.21.15.53:0/701404876 learned_addr learned my addr 172.21.15.53:0/701404876 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb562ffd700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c048150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb562ffd700 1 -- 172.21.15.53:0/2248015478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb55c045320 msgr2=0x7fb55c0f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb562ffd700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb55c045320 0x7fb55c0f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb562ffd700 1 -- 172.21.15.53:0/2248015478 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564066410 con 0x7fb55c0456f0 2023-09-28T00:23:08.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb563fff700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb55c0dc660 0x7fb55c048150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:08.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f3a89b9c700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f3a6806fb70 0x7f3a68071f80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f899a7fc700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a40c7f60 0x7f89a4168f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b5b0 tx=0x7f898c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f3a8939b700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3a680673c0 0x7f3a68069870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001bd0 tx=0x7f3a80001b40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.298+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efe70007460 con 0x7efe800c0e10 2023-09-28T00:23:08.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 -- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c3280 msgr2=0x7f71dc137e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-28T00:23:08.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71dc0c3280 0x7f71dc137e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 -- 172.21.15.53:0/701404876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71dc13b190 msgr2=0x7f71dc1400c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-28T00:23:08.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71dc13b190 0x7f71dc1400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7f71da7fc700 1 -- 172.21.15.53:0/701404876 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc009420 con 0x7f71dc15a830 2023-09-28T00:23:08.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fe3f699d700 1 Processor -- start 2023-09-28T00:23:08.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.300+0000 7fb562ffd700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb55c0456f0 0x7fb55c047c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb55000cb40 tx=0x7fb550001c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00f510 con 0x7f89a40c7f60 2023-09-28T00:23:08.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7fe3f699d700 1 -- start start 2023-09-28T00:23:08.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f71da7fc700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71dc15a830 0x7f71dc0c7eb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71d400cd60 tx=0x7f71d4001b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00f670 con 0x7f89a40c7f60 2023-09-28T00:23:08.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4151850 con 0x7f89a40c7f60 2023-09-28T00:23:08.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== osd.4 v2:172.21.15.118:6800/120721 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3a68072630 con 0x7f3a6806fb70 2023-09-28T00:23:08.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a4169bf0 con 0x7f89a40c7f60 2023-09-28T00:23:08.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7efe677fe700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe6c067480 0x7efe6c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe70084690 con 0x7efe800c0e10 2023-09-28T00:23:08.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7efe677fe700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7efe6c06fd30 0x7efe6c072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe6c0727f0 con 0x7efe6c06fd30 2023-09-28T00:23:08.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe70086c30 con 0x7efe800c0e10 2023-09-28T00:23:08.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400ab30 con 0x7f71dc15a830 2023-09-28T00:23:08.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400ac90 con 0x7f71dc15a830 2023-09-28T00:23:08.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400ab30 con 0x7f71dc15a830 2023-09-28T00:23:08.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0c77b0 con 0x7f71dc15a830 2023-09-28T00:23:08.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc0c1630 con 0x7f71dc15a830 2023-09-28T00:23:08.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550007360 con 0x7fb55c0456f0 2023-09-28T00:23:08.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.301+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5500074c0 con 0x7fb55c0456f0 2023-09-28T00:23:08.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f699d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f00ade00 0x7fe3f015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f699d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f01676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f699d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3f00c27a0 0x7fe3f014ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f699d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00cb7f0 con 0x7fe3f00ade00 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f699d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f015bc90 con 0x7fe3f00c27a0 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f699d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f015ab00 con 0x7fe3f00ae1d0 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7fe3f519a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f01676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f519a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f01676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41128/0 (socket says 172.21.15.53:41128) 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f519a700 1 -- 172.21.15.53:0/876416025 learned_addr learned my addr 172.21.15.53:0/876416025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f619c700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3f00c27a0 0x7fe3f014ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f619c700 1 -- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 msgr2=0x7fe3f01676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f619c700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3f00ae1d0 0x7fe3f01676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f619c700 1 -- 172.21.15.53:0/876416025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f00ade00 msgr2=0x7fe3f015c120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-28T00:23:08.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00fa10 con 0x7f89a40c7f60 2023-09-28T00:23:08.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fe3f599b700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f00ade00 0x7fe3f015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71dc04c3c0 con 0x7f71dc15a830 2023-09-28T00:23:08.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7fe3f619c700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f00ade00 0x7fe3f015c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7fe3f619c700 1 -- 172.21.15.53:0/876416025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0009420 con 0x7fe3f00c27a0 2023-09-28T00:23:08.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.302+0000 7efe7effd700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe6c067480 0x7efe6c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7fe3f619c700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3f00c27a0 0x7fe3f014ea00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007f00 tx=0x7fe3e8009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7fe3f599b700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f00ade00 0x7fe3f015c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:08.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8988000fd0 con 0x7f89a40c7f60 2023-09-28T00:23:08.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550004830 con 0x7fb55c0456f0 2023-09-28T00:23:08.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fb56a1ff700 1 -- 172.21.15.53:0/2248015478 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0057a0 con 0x7fb55c0456f0 2023-09-28T00:23:08.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8018070 con 0x7fe3f00c27a0 2023-09-28T00:23:08.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.303+0000 7fb56a1ff700 1 -- 172.21.15.53:0/2248015478 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0f1da0 con 0x7fb55c0456f0 2023-09-28T00:23:08.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.305+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e800ec40 con 0x7fe3f00c27a0 2023-09-28T00:23:08.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb55c005390 con 0x7fb55c0456f0 2023-09-28T00:23:08.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.305+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8014420 con 0x7fe3f00c27a0 2023-09-28T00:23:08.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.304+0000 7efe7ffff700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7efe6c06fd30 0x7efe6c072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.305+0000 7efe7ffff700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7efe6c06fd30 0x7efe6c072140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.306+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f71d40070f0 con 0x7f71dc15a830 2023-09-28T00:23:08.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.306+0000 7efe7effd700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe6c067480 0x7efe6c069930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe800c15d0 tx=0x7efe74017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.306+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f015ada0 con 0x7fe3f00c27a0 2023-09-28T00:23:08.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.307+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== osd.2 v2:172.21.15.53:6824/85121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7efe6c0727f0 con 0x7efe6c06fd30 2023-09-28T00:23:08.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.307+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f015b360 con 0x7fe3f00c27a0 2023-09-28T00:23:08.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.306+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f898c011400 con 0x7f89a40c7f60 2023-09-28T00:23:08.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.307+0000 7f71c2ffd700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f71c80673f0 0x7f71c80698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb55000a4f0 con 0x7fb55c0456f0 2023-09-28T00:23:08.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.307+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71d4084ac0 con 0x7f71dc15a830 2023-09-28T00:23:08.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f71c2ffd700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7f71c806fc20 0x7f71c8072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f899b7fe700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8984067400 0x7f89840698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f898c083e80 con 0x7f89a40c7f60 2023-09-28T00:23:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f899b7fe700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f898406fb40 0x7f8984071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 --> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8984072600 con 0x7f898406fb40 2023-09-28T00:23:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f898c086420 con 0x7f89a40c7f60 2023-09-28T00:23:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 --> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71c80726e0 con 0x7f71c806fc20 2023-09-28T00:23:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.308+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d400ab30 con 0x7f71dc15a830 2023-09-28T00:23:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.309+0000 7f71daffd700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f71c80673f0 0x7f71c80698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.309+0000 7f71db7fe700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7f71c806fc20 0x7f71c8072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.309+0000 7f71db7fe700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7f71c806fc20 0x7f71c8072030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.309+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3f0152b60 con 0x7fe3f00c27a0 2023-09-28T00:23:08.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.309+0000 7fb54f7fe700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb548067400 0x7fb5480698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.309+0000 7f89a37fe700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f898406fb40 0x7f8984071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb550084c20 con 0x7fb55c0456f0 2023-09-28T00:23:08.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7f71daffd700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f71c80673f0 0x7f71c80698a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0c3700 tx=0x7f71cc017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7fb54f7fe700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fb54806fb40 0x7fb548071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 --> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb548072600 con 0x7fb54806fb40 2023-09-28T00:23:08.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== osd.5 v2:172.21.15.118:6824/120751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f71c80726e0 con 0x7f71c806fc20 2023-09-28T00:23:08.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb550084f50 con 0x7fb55c0456f0 2023-09-28T00:23:08.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.310+0000 7f89a2ffd700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8984067400 0x7f89840698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.311+0000 7f89a37fe700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f898406fb40 0x7f8984071f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.311+0000 7fb5637fe700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb548067400 0x7fb5480698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.311+0000 7fb563fff700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fb54806fb40 0x7fb548071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.311+0000 7f89a2ffd700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8984067400 0x7f89840698b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8994009ab0 tx=0x7f8994018000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.312+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== osd.3 v2:172.21.15.53:6816/85094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8984072600 con 0x7f898406fb40 2023-09-28T00:23:08.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.312+0000 7fb563fff700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fb54806fb40 0x7fb548071f50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.312+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe3e8003020 con 0x7fe3f00c27a0 2023-09-28T00:23:08.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.313+0000 7fb5637fe700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb548067400 0x7fb5480698b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb558009b20 tx=0x7fb5580090f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.313+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== osd.6 v2:172.21.15.118:6808/120722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb548072600 con 0x7fb54806fb40 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.314+0000 7fe3e5ffb700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3d40674b0 0x7fe3d4069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.314+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3e80858b0 con 0x7fe3f00c27a0 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.315+0000 7fe3e5ffb700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7fe3d406fd60 0x7fe3d4072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.315+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 --> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3d4072820 con 0x7fe3d406fd60 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.315+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3e8085be0 con 0x7fe3f00c27a0 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.315+0000 7fe3f599b700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3d40674b0 0x7fe3d4069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.316+0000 7fe3f519a700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7fe3d406fd60 0x7fe3d4072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.317+0000 7fe3f519a700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7fe3d406fd60 0x7fe3d4072170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.317+0000 7fe3f599b700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3d40674b0 0x7fe3d4069960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec006d40 tx=0x7fe3ec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.318+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== osd.7 v2:172.21.15.118:6816/120752 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe3d4072820 con 0x7fe3d406fd60 2023-09-28T00:23:08.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.330+0000 7fbff259d700 1 -- 172.21.15.53:0/2507149333 --> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbfcc002c50 con 0x7fbfd006fb70 2023-09-28T00:23:08.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.331+0000 7fbfe17fa700 1 -- 172.21.15.53:0/2507149333 <== osd.1 v2:172.21.15.53:6802/85092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbfcc002c50 con 0x7fbfd006fb70 2023-09-28T00:23:08.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.332+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fbfd006fb70 msgr2=0x7fbfd0071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.332+0000 7fbfd6ffd700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fbfd006fb70 0x7fbfd0071f80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.332+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbfd00674b0 msgr2=0x7fbfd0069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.332+0000 7fbfd6ffd700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbfd00674b0 0x7fbfd0069960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80058d0 tx=0x7fbfe8009040 comp rx=0 tx=0).stop 2023-09-28T00:23:08.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.332+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 --> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8700ae060 con 0x7ff85006fcb0 2023-09-28T00:23:08.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.333+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 msgr2=0x7fbfec1551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.333+0000 7fbfd6ffd700 1 --2- 172.21.15.53:0/2507149333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfec0c4aa0 0x7fbfec1551c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c560 tx=0x7fbfdc007eb0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.333+0000 7fbff1d9c700 1 -- 172.21.15.53:0/2507149333 reap_dead start 2023-09-28T00:23:08.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.333+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 shutdown_connections 2023-09-28T00:23:08.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.333+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 >> 172.21.15.53:0/2507149333 conn(0x7fbfec067630 msgr2=0x7fbfec067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.334+0000 7ff85e7fc700 1 -- 172.21.15.53:0/3630527307 <== osd.0 v2:172.21.15.53:6800/85093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff8700ae060 con 0x7ff85006fcb0 2023-09-28T00:23:08.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.334+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 shutdown_connections 2023-09-28T00:23:08.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.334+0000 7fbfd6ffd700 1 -- 172.21.15.53:0/2507149333 wait complete. 2023-09-28T00:23:08.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.334+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7ff85006fcb0 msgr2=0x7ff8500720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.334+0000 7ff86f59e700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7ff85006fcb0 0x7ff8500720c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.335+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff850067480 msgr2=0x7ff850069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.335+0000 7ff86f59e700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff850067480 0x7ff850069930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff864006fd0 tx=0x7ff864008040 comp rx=0 tx=0).stop 2023-09-28T00:23:08.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8700ad7d0 msgr2=0x7ff87014b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 --> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a841559f0 con 0x7f3a6806fb70 2023-09-28T00:23:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7ff86f59e700 1 --2- 172.21.15.53:0/3630527307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8700ad7d0 0x7ff87014b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff87006b730 tx=0x7ff860017000 comp rx=0 tx=0).stop 2023-09-28T00:23:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7ff86ed9d700 1 -- 172.21.15.53:0/3630527307 reap_dead start 2023-09-28T00:23:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7f3a797fa700 1 -- 172.21.15.53:0/127345738 <== osd.4 v2:172.21.15.118:6800/120721 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a841559f0 con 0x7f3a6806fb70 2023-09-28T00:23:08.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 shutdown_connections 2023-09-28T00:23:08.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.336+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 >> 172.21.15.53:0/3630527307 conn(0x7ff8700c4c50 msgr2=0x7ff8701574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.337+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 shutdown_connections 2023-09-28T00:23:08.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.337+0000 7ff86f59e700 1 -- 172.21.15.53:0/3630527307 wait complete. 2023-09-28T00:23:08.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.338+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f3a6806fb70 msgr2=0x7f3a68071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.338+0000 7f3a8a39d700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f3a6806fb70 0x7f3a68071f80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.338+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3a680673c0 msgr2=0x7f3a68069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.338+0000 7f3a8a39d700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3a680673c0 0x7f3a68069870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001bd0 tx=0x7f3a80001b40 comp rx=0 tx=0).stop 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.339+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8415b390 msgr2=0x7f3a8415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.339+0000 7f3a8a39d700 1 --2- 172.21.15.53:0/127345738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8415b390 0x7f3a8415b800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00cf80 tx=0x7f3a7c007840 comp rx=0 tx=0).stop 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.339+0000 7f3a89b9c700 1 -- 172.21.15.53:0/127345738 reap_dead start 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.339+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 shutdown_connections 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.339+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 >> 172.21.15.53:0/127345738 conn(0x7f3a8406f830 msgr2=0x7f3a840cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.340+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 shutdown_connections 2023-09-28T00:23:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.340+0000 7f3a8a39d700 1 -- 172.21.15.53:0/127345738 wait complete. 2023-09-28T00:23:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.341+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 --> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe60002d30 con 0x7efe6c06fd30 2023-09-28T00:23:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.342+0000 7efe677fe700 1 -- 172.21.15.53:0/809476022 <== osd.2 v2:172.21.15.53:6824/85121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe60002d30 con 0x7efe6c06fd30 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.346+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7efe6c06fd30 msgr2=0x7efe6c072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.346+0000 7efe84f9d700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7efe6c06fd30 0x7efe6c072140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.346+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe6c067480 msgr2=0x7efe6c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7efe84f9d700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efe6c067480 0x7efe6c069930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe800c15d0 tx=0x7efe74017000 comp rx=0 tx=0).stop 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe800c0e10 msgr2=0x7efe80165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7efe84f9d700 1 --2- 172.21.15.53:0/809476022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe800c0e10 0x7efe80165340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe7000c8a0 tx=0x7efe70007d90 comp rx=0 tx=0).stop 2023-09-28T00:23:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7efe7ffff700 1 -- 172.21.15.53:0/809476022 reap_dead start 2023-09-28T00:23:08.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 --> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3f0152b60 con 0x7fe3d406fd60 2023-09-28T00:23:08.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 shutdown_connections 2023-09-28T00:23:08.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 --> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb55c04f680 con 0x7fb54806fb40 2023-09-28T00:23:08.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 >> 172.21.15.53:0/809476022 conn(0x7efe8006f830 msgr2=0x7efe8013c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.347+0000 7fe3e5ffb700 1 -- 172.21.15.53:0/876416025 <== osd.7 v2:172.21.15.118:6816/120752 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3f0152b60 con 0x7fe3d406fd60 2023-09-28T00:23:08.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.348+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 shutdown_connections 2023-09-28T00:23:08.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.348+0000 7fb54f7fe700 1 -- 172.21.15.53:0/2248015478 <== osd.6 v2:172.21.15.118:6808/120722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb55c04f680 con 0x7fb54806fb40 2023-09-28T00:23:08.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.348+0000 7efe84f9d700 1 -- 172.21.15.53:0/809476022 wait complete. 2023-09-28T00:23:08.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.348+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 --> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71dc06b2b0 con 0x7f71c806fc20 2023-09-28T00:23:08.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.348+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7fe3d406fd60 msgr2=0x7fe3d4072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fe3f699d700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7fe3d406fd60 0x7fe3d4072170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7f71c2ffd700 1 -- 172.21.15.53:0/701404876 <== osd.5 v2:172.21.15.118:6824/120751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71dc06b2b0 con 0x7f71c806fc20 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fb54806fb40 msgr2=0x7fb548071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fb54806fb40 0x7fb548071f50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb548067400 msgr2=0x7fb5480698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb548067400 0x7fb5480698b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb558009b20 tx=0x7fb5580090f0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb55c0456f0 msgr2=0x7fb55c047c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 --2- 172.21.15.53:0/2248015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb55c0456f0 0x7fb55c047c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb55000cb40 tx=0x7fb550001c30 comp rx=0 tx=0).stop 2023-09-28T00:23:08.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb563fff700 1 -- 172.21.15.53:0/2248015478 reap_dead start 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 shutdown_connections 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 >> 172.21.15.53:0/2248015478 conn(0x7fb55c00beb0 msgr2=0x7fb55c0db310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3d40674b0 msgr2=0x7fe3d4069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fe3f699d700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3d40674b0 0x7fe3d4069960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec006d40 tx=0x7fe3ec008040 comp rx=0 tx=0).stop 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3f00c27a0 msgr2=0x7fe3f014ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fe3f699d700 1 --2- 172.21.15.53:0/876416025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3f00c27a0 0x7fe3f014ea00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007f00 tx=0x7fe3e8009850 comp rx=0 tx=0).stop 2023-09-28T00:23:08.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.349+0000 7fe3f619c700 1 -- 172.21.15.53:0/876416025 reap_dead start 2023-09-28T00:23:08.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 --> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8988002d30 con 0x7f898406fb40 2023-09-28T00:23:08.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7f899b7fe700 1 -- 172.21.15.53:0/779838976 <== osd.3 v2:172.21.15.53:6816/85094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8988002d30 con 0x7f898406fb40 2023-09-28T00:23:08.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7f71c806fc20 msgr2=0x7f71c8072030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7f71dbfff700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7f71c806fc20 0x7f71c8072030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 shutdown_connections 2023-09-28T00:23:08.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7fb54d7fa700 1 -- 172.21.15.53:0/2248015478 wait complete. 2023-09-28T00:23:08.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f71c80673f0 msgr2=0x7f71c80698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f71dbfff700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f71c80673f0 0x7f71c80698a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0c3700 tx=0x7f71cc017000 comp rx=0 tx=0).stop 2023-09-28T00:23:08.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71dc15a830 msgr2=0x7f71dc0c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 shutdown_connections 2023-09-28T00:23:08.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 >> 172.21.15.53:0/876416025 conn(0x7fe3f00cbdf0 msgr2=0x7fe3f0151df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.350+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 shutdown_connections 2023-09-28T00:23:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f71dbfff700 1 --2- 172.21.15.53:0/701404876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71dc15a830 0x7f71dc0c7eb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71d400cd60 tx=0x7f71d4001b10 comp rx=0 tx=0).stop 2023-09-28T00:23:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f71db7fe700 1 -- 172.21.15.53:0/701404876 reap_dead start 2023-09-28T00:23:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 shutdown_connections 2023-09-28T00:23:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 >> 172.21.15.53:0/701404876 conn(0x7f71dc067630 msgr2=0x7f71dc15a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f898406fb40 msgr2=0x7f8984071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f89a95ff700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f898406fb40 0x7f8984071f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7fe3f699d700 1 -- 172.21.15.53:0/876416025 wait complete. 2023-09-28T00:23:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8984067400 msgr2=0x7f89840698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f89a95ff700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f8984067400 0x7f89840698b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8994009ab0 tx=0x7f8994018000 comp rx=0 tx=0).stop 2023-09-28T00:23:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a40c7f60 msgr2=0x7f89a4168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.351+0000 7f89a95ff700 1 --2- 172.21.15.53:0/779838976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89a40c7f60 0x7f89a4168f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b5b0 tx=0x7f898c0090f0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.352+0000 7f89a37fe700 1 -- 172.21.15.53:0/779838976 reap_dead start 2023-09-28T00:23:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.352+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 shutdown_connections 2023-09-28T00:23:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.352+0000 7f71dbfff700 1 -- 172.21.15.53:0/701404876 wait complete. 2023-09-28T00:23:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.352+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 shutdown_connections 2023-09-28T00:23:08.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.352+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 >> 172.21.15.53:0/779838976 conn(0x7f89a406ed60 msgr2=0x7f89a4157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.358+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 shutdown_connections 2023-09-28T00:23:08.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.358+0000 7f89a95ff700 1 -- 172.21.15.53:0/779838976 wait complete. 2023-09-28T00:23:08.417 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-09-28T00:23:08.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T00:23:08.418 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-09-28T00:23:08.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T00:23:08.420 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-09-28T00:23:08.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-28T00:23:08.421 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:08.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-28T00:23:08.422 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-09-28T00:23:08.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T00:23:08.423 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-09-28T00:23:08.423 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-28T00:23:08.424 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:08.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-28T00:23:08.425 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-09-28T00:23:08.425 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-28T00:23:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.789+0000 7f50cd19d700 1 Processor -- start 2023-09-28T00:23:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.789+0000 7f50cd19d700 1 -- start start 2023-09-28T00:23:08.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.791+0000 7f50cd19d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50c000e470 0x7f50c004bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.791+0000 7f50cd19d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c0006030 con 0x7f50c0006d60 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.791+0000 7f50cd19d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00068d0 con 0x7f50c0035df0 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.791+0000 7f50cd19d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c004aeb0 con 0x7f50c000e470 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.792+0000 7f50c7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50c000e470 0x7f50c004bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.792+0000 7f50c7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50c000e470 0x7f50c004bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60730/0 (socket says 172.21.15.53:60730) 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.792+0000 7f50c7fff700 1 -- 172.21.15.53:0/1930364188 learned_addr learned my addr 172.21.15.53:0/1930364188 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986612978 0 0) 0x7f50c0006030 con 0x7f50c0006d60 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b8003570 con 0x7f50c0006d60 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234986008 0 0) 0x7f50b8003570 con 0x7f50c0006d60 2023-09-28T00:23:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 >> v2:172.21.15.53:3300/0 conn(0x7f50c000e470 msgr2=0x7f50c004bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 --2- 172.21.15.53:0/1930364188 >> v2:172.21.15.53:3300/0 conn(0x7f50c000e470 0x7f50c004bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 >> v1:172.21.15.118:6789/0 conn(0x7f50c0035df0 legacy=0x7f50c00dd4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.793+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c004b170 con 0x7f50c0006d60 2023-09-28T00:23:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 107228552 0 0) 0x7f50bc001470 con 0x7f50c0006d60 2023-09-28T00:23:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 >> v1:172.21.15.53:6789/0 conn(0x7f50c0006d60 legacy=0x7f50c0045c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8003bb0 0x7f50b8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50b8004810 0x7f50b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50b8005440 0x7f50b801cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c004aeb0 con 0x7f50b8005440 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b801d380 con 0x7f50b8003bb0 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b801d540 con 0x7f50b8004810 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.794+0000 7f50c7fff700 1 --2- 172.21.15.53:0/1930364188 >> v2:172.21.15.53:3300/0 conn(0x7f50c000e470 0x7f50c004bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c77fe700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50b8004810 0x7f50b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c7fff700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8003bb0 0x7f50b8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c77fe700 1 -- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8003bb0 msgr2=0x7f50b8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c77fe700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8003bb0 0x7f50b8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c77fe700 1 -- 172.21.15.53:0/1930364188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50b8005440 msgr2=0x7f50b801cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50cc99c700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50b8005440 0x7f50b801cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c77fe700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50b8005440 0x7f50b801cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50c77fe700 1 -- 172.21.15.53:0/1930364188 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8003570 con 0x7f50b8004810 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50cc99c700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50b8005440 0x7f50b801cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.795+0000 7f50cc99c700 1 -- 172.21.15.53:0/1930364188 reap_dead start 2023-09-28T00:23:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.796+0000 7f50c77fe700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50b8004810 0x7f50b8004c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50bc002690 tx=0x7f50bc008a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2448def1c726aed3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.798+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc007830 con 0x7f50b8004810 2023-09-28T00:23:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.798+0000 7f50c6ffd700 1 -- 172.21.15.53:0/1930364188 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc007990 con 0x7f50b8004810 2023-09-28T00:23:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.799+0000 7f50cd19d700 1 -- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50b8004810 msgr2=0x7f50b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.799+0000 7f50cd19d700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50b8004810 0x7f50b8004c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50bc002690 tx=0x7f50bc008a20 comp rx=0 tx=0).stop 2023-09-28T00:23:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.800+0000 7f50cd19d700 1 -- 172.21.15.53:0/1930364188 shutdown_connections 2023-09-28T00:23:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.800+0000 7f50cd19d700 1 --2- 172.21.15.53:0/1930364188 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50b8004810 0x7f50b8004c80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.800+0000 7f50cd19d700 1 -- 172.21.15.53:0/1930364188 >> 172.21.15.53:0/1930364188 conn(0x7f50c000bfc0 msgr2=0x7f50c000c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.801+0000 7f354359e700 1 Processor -- start 2023-09-28T00:23:08.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.801+0000 7fb1a37ff700 1 Processor -- start 2023-09-28T00:23:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.802+0000 7fa2ddbff700 1 Processor -- start 2023-09-28T00:23:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.802+0000 7f50cd19d700 1 -- 172.21.15.53:0/1930364188 shutdown_connections 2023-09-28T00:23:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.802+0000 7f354359e700 1 -- start start 2023-09-28T00:23:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.802+0000 7f50cd19d700 1 -- 172.21.15.53:0/1930364188 wait complete. 2023-09-28T00:23:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7f354359e700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f353c0071b0 0x7f353c04f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.801+0000 7fb1a37ff700 1 -- start start 2023-09-28T00:23:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7f50cd19d700 1 Processor -- start 2023-09-28T00:23:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7fb1a37ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7fb1a37ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb19404be40 0x7fb194045f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7fb1a37ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb194007700 0x7fb1940dd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7fb1a37ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb194046c20 con 0x7fb19404be40 2023-09-28T00:23:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7fb1a37ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940dafe0 con 0x7fb194007700 2023-09-28T00:23:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7fb1a37ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940464c0 con 0x7fb1940d7500 2023-09-28T00:23:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7f354359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0de850 0x7f353c007580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7f354359e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353c007ac0 con 0x7f353c00f9d0 2023-09-28T00:23:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7f354359e700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c0ded90 con 0x7f353c0071b0 2023-09-28T00:23:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.804+0000 7f354359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c04a200 con 0x7f353c0de850 2023-09-28T00:23:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7f354259c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f353c0071b0 0x7f353c04f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.803+0000 7fa2ddbff700 1 -- start start 2023-09-28T00:23:08.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fb1a1d9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb194007700 0x7fb1940dd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fb1a159b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fb1a159b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41154/0 (socket says 172.21.15.53:41154) 2023-09-28T00:23:08.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fb1a159b700 1 -- 172.21.15.53:0/3207154202 learned_addr learned my addr 172.21.15.53:0/3207154202 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fa2ddbff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2d00dc4e0 0x7fa2d00e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fa2ddbff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa2d00075f0 0x7fa2d0045300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fa2ddbff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d0036100 con 0x7fa2d0045840 2023-09-28T00:23:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fa2ddbff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0045c60 con 0x7fa2d00dc4e0 2023-09-28T00:23:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fa2ddbff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0007210 con 0x7fa2d00075f0 2023-09-28T00:23:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7f354259c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f353c0071b0 0x7f353c04f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60750/0 (socket says 172.21.15.53:60750) 2023-09-28T00:23:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7fb1a0d9a700 1 --2- 172.21.15.53:0/3207154202 >> v2:172.21.15.53:3300/0 conn(0x7fb19404be40 0x7fb194045f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7f354259c700 1 -- 172.21.15.53:0/3797892474 learned_addr learned my addr 172.21.15.53:0/3797892474 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f354259c700 1 -- 172.21.15.53:0/3797892474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0de850 msgr2=0x7f353c007580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T00:23:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fa2d6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa2d00075f0 0x7fa2d0045300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f354259c700 1 --2- 172.21.15.53:0/3797892474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0de850 0x7f353c007580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fa2d6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa2d00075f0 0x7fa2d0045300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34690/0 (socket says 172.21.15.53:34690) 2023-09-28T00:23:08.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fa2d6ffd700 1 -- 172.21.15.53:0/1326674712 learned_addr learned my addr 172.21.15.53:0/1326674712 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fb1a159b700 1 -- 172.21.15.53:0/3207154202 >> v2:172.21.15.118:3300/0 conn(0x7fb194007700 msgr2=0x7fb1940dd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3207154202 >> v2:172.21.15.118:3300/0 conn(0x7fb194007700 0x7fb1940dd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fb1a159b700 1 -- 172.21.15.53:0/3207154202 >> v2:172.21.15.53:3300/0 conn(0x7fb19404be40 msgr2=0x7fb194045f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.805+0000 7f50cd19d700 1 -- start start 2023-09-28T00:23:08.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f50cd19d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8004810 0x7f50c00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3207154202 >> v2:172.21.15.53:3300/0 conn(0x7fb19404be40 0x7fb194045f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f354259c700 1 -- 172.21.15.53:0/3797892474 >> v1:172.21.15.118:6789/0 conn(0x7f353c00f9d0 legacy=0x7f353c00e2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f50cd19d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 0x7f50c00e1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f50c7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8004810 0x7f50c00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7f50c7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8004810 0x7f50c00caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34702/0 (socket says 172.21.15.53:34702) 2023-09-28T00:23:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fb1a159b700 1 -- 172.21.15.53:0/3207154202 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194045af0 con 0x7fb1940d7500 2023-09-28T00:23:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7fb1a0d9a700 1 --2- 172.21.15.53:0/3207154202 >> v2:172.21.15.53:3300/0 conn(0x7fb19404be40 0x7fb194045f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.806+0000 7fa2d6ffd700 1 -- 172.21.15.53:0/1326674712 >> v2:172.21.15.53:3300/0 conn(0x7fa2d00dc4e0 msgr2=0x7fa2d00e22e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7fa2d6ffd700 1 --2- 172.21.15.53:0/1326674712 >> v2:172.21.15.53:3300/0 conn(0x7fa2d00dc4e0 0x7fa2d00e22e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7fa2d6ffd700 1 -- 172.21.15.53:0/1326674712 >> v1:172.21.15.118:6789/0 conn(0x7fa2d0045840 legacy=0x7fa2d00e38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7fa2d6ffd700 1 -- 172.21.15.53:0/1326674712 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00060c0 con 0x7fa2d00075f0 2023-09-28T00:23:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f354159a700 1 -- 172.21.15.53:0/3797892474 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338622739 0 0) 0x7f353c007ac0 con 0x7f353c00f9d0 2023-09-28T00:23:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3207154202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404adc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb19c066bf0 tx=0x7fb19c06b0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41908c60eb9f3f3e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f50c77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 0x7f50c00e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f50c77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 0x7f50c00e1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60764/0 (socket says 172.21.15.53:60764) 2023-09-28T00:23:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f50c7fff700 1 -- 172.21.15.53:0/3589391087 learned_addr learned my addr 172.21.15.53:0/3589391087 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f50cd19d700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50c004f830 0x7f50c004fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7fa2d6ffd700 1 --2- 172.21.15.53:0/1326674712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d00075f0 0x7fa2d0045300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000da40 tx=0x7fa2c4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a652bd99eaf35450 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00d85d0 con 0x7f50c00e0c20 2023-09-28T00:23:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.807+0000 7f354259c700 1 -- 172.21.15.53:0/3797892474 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0495f0 con 0x7f353c0071b0 2023-09-28T00:23:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c004f3a0 con 0x7f50b8004810 2023-09-28T00:23:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cc99c700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50c004f830 0x7f50c004fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7fb193fff700 1 -- 172.21.15.53:0/3207154202 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c064d40 con 0x7fb1940d7500 2023-09-28T00:23:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f354259c700 1 --2- 172.21.15.53:0/3797892474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c0071b0 0x7f353c04f000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35380099b0 tx=0x7f3538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ccb12e61d97e1f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7fa2d67fc700 1 -- 172.21.15.53:0/1326674712 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400b860 con 0x7fa2d00075f0 2023-09-28T00:23:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7fa2d67fc700 1 -- 172.21.15.53:0/1326674712 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400b9c0 con 0x7fa2d00075f0 2023-09-28T00:23:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00501e0 con 0x7f50c004f830 2023-09-28T00:23:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cc99c700 1 -- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8004810 msgr2=0x7f50c00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cc99c700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8004810 0x7f50c00caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cc99c700 1 -- 172.21.15.53:0/3589391087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 msgr2=0x7f50c00e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f354159a700 1 -- 172.21.15.53:0/3797892474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800b8f0 con 0x7f353c0071b0 2023-09-28T00:23:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7f354159a700 1 -- 172.21.15.53:0/3797892474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353800ba50 con 0x7f353c0071b0 2023-09-28T00:23:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cc99c700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 0x7f50c00e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50cc99c700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00d9fa0 con 0x7f50c004f830 2023-09-28T00:23:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7f50c77fe700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 0x7f50c00e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7fb193fff700 1 -- 172.21.15.53:0/3207154202 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c064ec0 con 0x7fb1940d7500 2023-09-28T00:23:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.808+0000 7fb193fff700 1 -- 172.21.15.53:0/3207154202 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c063480 con 0x7fb1940d7500 2023-09-28T00:23:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3207154202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 msgr2=0x7fb19404adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7fb1a37ff700 1 --2- 172.21.15.53:0/3207154202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404adc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb19c066bf0 tx=0x7fb19c06b0e0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1326674712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d00075f0 msgr2=0x7fa2d0045300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1326674712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d00075f0 0x7fa2d0045300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000da40 tx=0x7fa2c4009250 comp rx=0 tx=0).stop 2023-09-28T00:23:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7f354159a700 1 -- 172.21.15.53:0/3797892474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800bdf0 con 0x7f353c0071b0 2023-09-28T00:23:08.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.809+0000 7f50cc99c700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50c004f830 0x7f50c004fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50c000cf80 tx=0x7f50b4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f354359e700 1 -- 172.21.15.53:0/3797892474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c0071b0 msgr2=0x7f353c04f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3207154202 shutdown_connections 2023-09-28T00:23:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fb1a37ff700 1 --2- 172.21.15.53:0/3207154202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404adc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fb1a37ff700 1 --2- 172.21.15.53:0/3207154202 >> v2:172.21.15.118:3300/0 conn(0x7fb194007700 0x7fb1940dd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fb1a37ff700 1 --2- 172.21.15.53:0/3207154202 >> v2:172.21.15.53:3300/0 conn(0x7fb19404be40 0x7fb194045f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3207154202 >> 172.21.15.53:0/3207154202 conn(0x7fb19400c050 msgr2=0x7fb19400c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40113d0 con 0x7f50c004f830 2023-09-28T00:23:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b400c050 con 0x7f50c004f830 2023-09-28T00:23:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40117a0 con 0x7f50c004f830 2023-09-28T00:23:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1326674712 shutdown_connections 2023-09-28T00:23:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1326674712 >> v2:172.21.15.53:3300/0 conn(0x7fa2d00dc4e0 0x7fa2d00e22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1326674712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d00075f0 0x7fa2d0045300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1326674712 >> 172.21.15.53:0/1326674712 conn(0x7fa2d000c050 msgr2=0x7fa2d000c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c00da240 con 0x7f50c004f830 2023-09-28T00:23:08.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1326674712 shutdown_connections 2023-09-28T00:23:08.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1326674712 wait complete. 2023-09-28T00:23:08.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c00d82f0 con 0x7f50c004f830 2023-09-28T00:23:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.810+0000 7f354359e700 1 --2- 172.21.15.53:0/3797892474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c0071b0 0x7f353c04f000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35380099b0 tx=0x7f3538009250 comp rx=0 tx=0).stop 2023-09-28T00:23:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.811+0000 7f354359e700 1 -- 172.21.15.53:0/3797892474 shutdown_connections 2023-09-28T00:23:08.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.811+0000 7f354359e700 1 --2- 172.21.15.53:0/3797892474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c0071b0 0x7f353c04f000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.811+0000 7f354359e700 1 --2- 172.21.15.53:0/3797892474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0de850 0x7f353c007580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.811+0000 7f354359e700 1 -- 172.21.15.53:0/3797892474 >> 172.21.15.53:0/3797892474 conn(0x7f353c051100 msgr2=0x7f353c051500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.811+0000 7f354359e700 1 -- 172.21.15.53:0/3797892474 shutdown_connections 2023-09-28T00:23:08.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.811+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c00054e0 con 0x7f50c004f830 2023-09-28T00:23:08.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.812+0000 7f354359e700 1 -- 172.21.15.53:0/3797892474 wait complete. 2023-09-28T00:23:08.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.812+0000 7fa2ddbff700 1 Processor -- start 2023-09-28T00:23:08.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.812+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3207154202 shutdown_connections 2023-09-28T00:23:08.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.813+0000 7fa2ddbff700 1 -- start start 2023-09-28T00:23:08.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.814+0000 7f354359e700 1 Processor -- start 2023-09-28T00:23:08.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.814+0000 7f354359e700 1 -- start start 2023-09-28T00:23:08.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.813+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3207154202 wait complete. 2023-09-28T00:23:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.813+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f50b4011bd0 con 0x7f50c004f830 2023-09-28T00:23:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7f50b3fff700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f50ac067480 0x7f50ac069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fa2ddbff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2d0045840 0x7fa2d0047eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.814+0000 7f7684f9d700 1 Processor -- start 2023-09-28T00:23:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.814+0000 7f7684f9d700 1 -- start start 2023-09-28T00:23:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fa2ddbff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d00dc4e0 0x7fa2d00de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fa2ddbff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d004a4c0 0x7fa2d004f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fb1a37ff700 1 Processor -- start 2023-09-28T00:23:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fb1a37ff700 1 -- start start 2023-09-28T00:23:08.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fa2ddbff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0047b30 con 0x7fa2d00dc4e0 2023-09-28T00:23:08.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f50b4083ae0 con 0x7f50c004f830 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.815+0000 7fa2ddbff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00ddc00 con 0x7fa2d004a4c0 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d004a4c0 0x7fa2d004f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d004a4c0 0x7fa2d004f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34718/0 (socket says 172.21.15.53:34718) 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d7fff700 1 -- 172.21.15.53:0/1497982094 learned_addr learned my addr 172.21.15.53:0/1497982094 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00dcec0 con 0x7fa2d0045840 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d77fe700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2d0045840 0x7fa2d0047eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7f50c7fff700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f50ac067480 0x7f50ac069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d77fe700 1 -- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d004a4c0 msgr2=0x7fa2d004f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d77fe700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d004a4c0 0x7fa2d004f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d77fe700 1 -- 172.21.15.53:0/1497982094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d00dc4e0 msgr2=0x7fa2d00de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f354359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 0x7f353c0ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fb1a37ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194007700 0x7fb194034cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fb1a37ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 0x7fb19404e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fb1a37ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fb1a37ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19404e230 con 0x7fb19404be40 2023-09-28T00:23:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fb1a37ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19404e510 con 0x7fb194007700 2023-09-28T00:23:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fb1a37ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940ff0f0 con 0x7fb1940d7500 2023-09-28T00:23:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f354359e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c00f9d0 0x7f353c0da300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f7684f9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7678006c40 0x7f767804bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f7684f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 0x7f7678035f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f7684f9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7678005f10 con 0x7f767800e350 2023-09-28T00:23:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f7684f9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780067b0 con 0x7f7678006c40 2023-09-28T00:23:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f7684f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767804b050 con 0x7f7678035b10 2023-09-28T00:23:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f354359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353c0de850 0x7f353c0e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d77fe700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d00dc4e0 0x7fa2d00de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f50c7fff700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f50ac067480 0x7f50ac069930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50c804d2d0 tx=0x7f50c806b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7fb1a0d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 0x7fb19404e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7f767ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 0x7f7678035f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 0x7f7678035f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41196/0 (socket says 172.21.15.53:41196) 2023-09-28T00:23:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767ffff700 1 -- 172.21.15.53:0/1729339708 learned_addr learned my addr 172.21.15.53:0/1729339708 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f354359e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c030610 con 0x7f353c00f9d0 2023-09-28T00:23:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f354359e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c04baf0 con 0x7f353c0de850 2023-09-28T00:23:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7fb1a0d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 0x7fb19404e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60788/0 (socket says 172.21.15.53:60788) 2023-09-28T00:23:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f354359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c04bdd0 con 0x7f353c0071b0 2023-09-28T00:23:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767f7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f767800e350 0x7f7678045b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54332/0 (socket says 172.21.15.53:54332) 2023-09-28T00:23:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f3542d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353c0de850 0x7f353c0e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7fb1a0d9a700 1 -- 172.21.15.53:0/3859639824 learned_addr learned my addr 172.21.15.53:0/3859639824 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f354259c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 0x7f353c0ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f354259c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 0x7f353c0ee070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41186/0 (socket says 172.21.15.53:41186) 2023-09-28T00:23:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f354259c700 1 -- 172.21.15.53:0/2554699383 learned_addr learned my addr 172.21.15.53:0/2554699383 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767ffff700 1 -- 172.21.15.53:0/1729339708 >> v2:172.21.15.53:3300/0 conn(0x7f7678006c40 msgr2=0x7f767804bb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194007700 0x7fb194034cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f5f347ff700 1 Processor -- start 2023-09-28T00:23:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f3541d9b700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c00f9d0 0x7f353c0da300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7fb1a1d9c700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.816+0000 7fa2d77fe700 1 -- 172.21.15.53:0/1497982094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40094f0 con 0x7fa2d0045840 2023-09-28T00:23:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.817+0000 7fa2d77fe700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2d0045840 0x7fa2d0047eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b5b0 tx=0x7fa2cc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767ffff700 1 --2- 172.21.15.53:0/1729339708 >> v2:172.21.15.53:3300/0 conn(0x7f7678006c40 0x7f767804bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767ffff700 1 -- 172.21.15.53:0/1729339708 >> v1:172.21.15.118:6789/0 conn(0x7f767800e350 legacy=0x7f7678045b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.818+0000 7f767ffff700 1 -- 172.21.15.53:0/1729339708 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678006160 con 0x7f7678035b10 2023-09-28T00:23:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f767ffff700 1 --2- 172.21.15.53:0/1729339708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 0x7f7678035f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f768002b6c0 tx=0x7f7680066740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c563ba4319036f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7fb1a159b700 1 -- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 msgr2=0x7fb19404eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f354259c700 1 -- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353c0de850 msgr2=0x7f353c0e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f354259c700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353c0de850 0x7f353c0e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f354259c700 1 -- 172.21.15.53:0/2554699383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c00f9d0 msgr2=0x7f353c0da300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f354259c700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c00f9d0 0x7f353c0da300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f354259c700 1 -- 172.21.15.53:0/2554699383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380094f0 con 0x7f353c0071b0 2023-09-28T00:23:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f3541d9b700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c00f9d0 0x7f353c0da300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7fb1a159b700 1 -- 172.21.15.53:0/3859639824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 msgr2=0x7fb19404e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f3542d9d700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353c0de850 0x7f353c0e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 0x7fb19404e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f5f347ff700 1 -- start start 2023-09-28T00:23:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7fb1a159b700 1 -- 172.21.15.53:0/3859639824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c066410 con 0x7fb194007700 2023-09-28T00:23:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7fb1a0d9a700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 0x7fb19404e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.819+0000 7f354259c700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 0x7f353c0ee070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35380094c0 tx=0x7f3538017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fb1a159b700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194007700 0x7fb194034cd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb19c02b6c0 tx=0x7fb19c090000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c069e30 con 0x7fb194007700 2023-09-28T00:23:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fc3add9d700 1 Processor -- start 2023-09-28T00:23:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3859639824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940d63d0 con 0x7fb194007700 2023-09-28T00:23:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c063a50 con 0x7fb194007700 2023-09-28T00:23:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c063e30 con 0x7fb194007700 2023-09-28T00:23:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3859639824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940d6990 con 0x7fb194007700 2023-09-28T00:23:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.820+0000 7fc3add9d700 1 -- start start 2023-09-28T00:23:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011e10 con 0x7f353c0071b0 2023-09-28T00:23:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f5f347ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5f2c0c7f60 0x7f5f2c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f5f347ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f2c0c6920 0x7f5f2c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f5f347ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c0c8ba0 con 0x7f5f2c0c7b90 2023-09-28T00:23:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f5f347ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c0c8990 con 0x7f5f2c0c6920 2023-09-28T00:23:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f5f347ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c159d00 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353801a630 con 0x7f353c0071b0 2023-09-28T00:23:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353801a9f0 con 0x7f353c0071b0 2023-09-28T00:23:08.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00f510 con 0x7fa2d0045840 2023-09-28T00:23:08.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00f670 con 0x7fa2d0045840 2023-09-28T00:23:08.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f50b40509c0 con 0x7f50c004f830 2023-09-28T00:23:08.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f354359e700 1 -- 172.21.15.53:0/2554699383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c04c0b0 con 0x7f353c0071b0 2023-09-28T00:23:08.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00fa10 con 0x7fa2d0045840 2023-09-28T00:23:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7f354359e700 1 -- 172.21.15.53:0/2554699383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c04c670 con 0x7f353c0071b0 2023-09-28T00:23:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d00dd160 con 0x7fa2d0045840 2023-09-28T00:23:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f5f32d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f2c0c6920 0x7f5f2c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7f5f32d9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f2c0c6920 0x7f5f2c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60814/0 (socket says 172.21.15.53:60814) 2023-09-28T00:23:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2236015185 learned_addr learned my addr 172.21.15.53:0/2236015185 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7f5f31d9a700 1 --2- 172.21.15.53:0/2236015185 >> v2:172.21.15.118:3300/0 conn(0x7f5f2c0c7f60 0x7f5f2c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d00dd640 con 0x7fa2d0045840 2023-09-28T00:23:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f767e7fc700 1 -- 172.21.15.53:0/1729339708 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680064990 con 0x7f7678035b10 2023-09-28T00:23:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f767e7fc700 1 -- 172.21.15.53:0/1729339708 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680063230 con 0x7f7678035b10 2023-09-28T00:23:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.821+0000 7f767e7fc700 1 -- 172.21.15.53:0/1729339708 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800633c0 con 0x7f7678035b10 2023-09-28T00:23:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7f7684f9d700 1 -- 172.21.15.53:0/1729339708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 msgr2=0x7f7678035f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7f7684f9d700 1 --2- 172.21.15.53:0/1729339708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 0x7f7678035f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f768002b6c0 tx=0x7f7680066740 comp rx=0 tx=0).stop 2023-09-28T00:23:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7fc3acd9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc3a80c4440 0x7fc3a80c4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54360/0 (socket says 172.21.15.53:54360) 2023-09-28T00:23:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7fc3add9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3a806dea0 0x7fc3a8155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7f7684f9d700 1 -- 172.21.15.53:0/1729339708 shutdown_connections 2023-09-28T00:23:08.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7f354359e700 1 -- 172.21.15.53:0/2554699383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353c0057d0 con 0x7f353c0071b0 2023-09-28T00:23:08.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3859639824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb194005530 con 0x7fb194007700 2023-09-28T00:23:08.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2236015185 >> v2:172.21.15.118:3300/0 conn(0x7f5f2c0c7f60 msgr2=0x7f5f2c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.822+0000 7f5f32d9c700 1 --2- 172.21.15.53:0/2236015185 >> v2:172.21.15.118:3300/0 conn(0x7f5f2c0c7f60 0x7f5f2c1597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2236015185 >> v1:172.21.15.118:6789/0 conn(0x7f5f2c0c7b90 legacy=0x7f5f2c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2236015185 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0c8e80 con 0x7f5f2c0c6920 2023-09-28T00:23:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.823+0000 7f5f32d9c700 1 --2- 172.21.15.53:0/2236015185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c6920 0x7f5f2c0699a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c159e90 tx=0x7f5f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2d706043a5459f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb19c06f3e0 con 0x7fb194007700 2023-09-28T00:23:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7fb1917fa700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb1800673b0 0x7fb180069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb19c0fd440 con 0x7fb194007700 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7fa2c17fa700 1 -- 172.21.15.53:0/1497982094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b80052b0 con 0x7fa2d0045840 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7f5f31599700 1 -- 172.21.15.53:0/2236015185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00b760 con 0x7f5f2c0c6920 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7f5f31599700 1 -- 172.21.15.53:0/2236015185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c00b8c0 con 0x7f5f2c0c6920 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f31599700 1 -- 172.21.15.53:0/2236015185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00bc60 con 0x7f5f2c0c6920 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f347ff700 1 -- 172.21.15.53:0/2236015185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c6920 msgr2=0x7f5f2c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2236015185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c6920 0x7f5f2c0699a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c159e90 tx=0x7f5f1c009250 comp rx=0 tx=0).stop 2023-09-28T00:23:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7fc3acd9b700 1 -- 172.21.15.53:0/238378018 learned_addr learned my addr 172.21.15.53:0/238378018 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7fc3a7fff700 1 --2- 172.21.15.53:0/238378018 >> v2:172.21.15.53:3300/0 conn(0x7fc3a806dea0 0x7fc3a8155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a81526c0 con 0x7fc3a806e910 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a81517f0 con 0x7fc3a80c4440 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a8151ab0 con 0x7fc3a806dea0 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7fc3a7fff700 1 -- 172.21.15.53:0/238378018 >> v1:172.21.15.118:6789/0 conn(0x7fc3a80c4440 legacy=0x7fc3a80c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7fc3a7fff700 1 -- 172.21.15.53:0/238378018 >> v1:172.21.15.53:6789/0 conn(0x7fc3a806e910 legacy=0x7fc3a806ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.825+0000 7fc3a7fff700 1 -- 172.21.15.53:0/238378018 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8151d90 con 0x7fc3a806dea0 2023-09-28T00:23:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7fc3a7fff700 1 --2- 172.21.15.53:0/238378018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806dea0 0x7fc3a8155730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3940098e0 tx=0x7fc3940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf2fe4eb66155c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f347ff700 1 -- 172.21.15.53:0/2236015185 shutdown_connections 2023-09-28T00:23:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2236015185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c6920 0x7f5f2c0699a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2236015185 >> v2:172.21.15.118:3300/0 conn(0x7f5f2c0c7f60 0x7f5f2c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7f5f347ff700 1 -- 172.21.15.53:0/2236015185 >> 172.21.15.53:0/2236015185 conn(0x7f5f2c06ed60 msgr2=0x7f5f2c06f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7f7684f9d700 1 --2- 172.21.15.53:0/1729339708 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678035b10 0x7f7678035f70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.826+0000 7fb1a0d9a700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb1800673b0 0x7fb180069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f353802e450 con 0x7f353c0071b0 2023-09-28T00:23:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7f7684f9d700 1 --2- 172.21.15.53:0/1729339708 >> v2:172.21.15.53:3300/0 conn(0x7f7678006c40 0x7f767804bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.824+0000 7f7684f9d700 1 -- 172.21.15.53:0/1729339708 >> 172.21.15.53:0/1729339708 conn(0x7f767800bea0 msgr2=0x7f767800c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7fc3a77fe700 1 -- 172.21.15.53:0/238378018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394009e80 con 0x7fc3a806dea0 2023-09-28T00:23:08.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7f7684f9d700 1 -- 172.21.15.53:0/1729339708 shutdown_connections 2023-09-28T00:23:08.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7fc3a77fe700 1 -- 172.21.15.53:0/238378018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39400b820 con 0x7fc3a806dea0 2023-09-28T00:23:08.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7fc3a77fe700 1 -- 172.21.15.53:0/238378018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400bba0 con 0x7fc3a806dea0 2023-09-28T00:23:08.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7fb1a0d9a700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb1800673b0 0x7fb180069860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1940d1af0 tx=0x7fb18c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa2cc011400 con 0x7fa2d0045840 2023-09-28T00:23:08.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.828+0000 7f5f347ff700 1 -- 172.21.15.53:0/2236015185 shutdown_connections 2023-09-28T00:23:08.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.828+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806dea0 msgr2=0x7fc3a8155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.828+0000 7fc3add9d700 1 --2- 172.21.15.53:0/238378018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806dea0 0x7fc3a8155730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3940098e0 tx=0x7fc3940091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7f35327fc700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f35240674b0 0x7f3524069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7fa2c37fe700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa2bc0674b0 0x7fa2bc069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 shutdown_connections 2023-09-28T00:23:08.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7fc3add9d700 1 --2- 172.21.15.53:0/238378018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806dea0 0x7fc3a8155730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 >> 172.21.15.53:0/238378018 conn(0x7fc3a8067630 msgr2=0x7fc3a8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35380866a0 con 0x7f353c0071b0 2023-09-28T00:23:08.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2cc083e20 con 0x7fa2d0045840 2023-09-28T00:23:08.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.827+0000 7f7684f9d700 1 -- 172.21.15.53:0/1729339708 wait complete. 2023-09-28T00:23:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7f5f347ff700 1 -- 172.21.15.53:0/2236015185 wait complete. 2023-09-28T00:23:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7f3541d9b700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f35240674b0 0x7f3524069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 shutdown_connections 2023-09-28T00:23:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.830+0000 7fc3add9d700 1 -- 172.21.15.53:0/238378018 wait complete. 2023-09-28T00:23:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.829+0000 7f7684f9d700 1 Processor -- start 2023-09-28T00:23:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.830+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb19c0ca350 con 0x7fb194007700 2023-09-28T00:23:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.830+0000 7fa2d6ffd700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa2bc0674b0 0x7fa2bc069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.830+0000 7f7684f9d700 1 -- start start 2023-09-28T00:23:08.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.831+0000 7f5f347ff700 1 Processor -- start 2023-09-28T00:23:08.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.831+0000 7f3541d9b700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f35240674b0 0x7f3524069960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3534006fd0 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.831+0000 7f5f347ff700 1 -- start start 2023-09-28T00:23:08.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7fc3add9d700 1 Processor -- start 2023-09-28T00:23:08.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f7684f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678006c40 0x7f76780fae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3538053580 con 0x7f353c0071b0 2023-09-28T00:23:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f7684f9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f767800e350 0x7f76780453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f347ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2c0c6920 0x7f5f2c0acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f347ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c7b90 0x7f5f2c0c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f347ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 0x7f5f2c0c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f347ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0cac60 con 0x7f5f2c0c7b90 2023-09-28T00:23:08.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f347ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0c9d90 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f347ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0ca050 con 0x7f5f2c0c6920 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f767f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678006c40 0x7f76780fae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f7684f9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7678035b10 0x7f76780cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f767f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678006c40 0x7f76780fae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41208/0 (socket says 172.21.15.53:41208) 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f7684f9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780fd9e0 con 0x7f7678035b10 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f7684f9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780fdc80 con 0x7f767800e350 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f7684f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780fdf60 con 0x7f7678006c40 2023-09-28T00:23:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f767f7fe700 1 -- 172.21.15.53:0/3156753876 learned_addr learned my addr 172.21.15.53:0/3156753876 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.832+0000 7f5f32d9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 0x7f5f2c0c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 0x7f5f2c0c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34752/0 (socket says 172.21.15.53:34752) 2023-09-28T00:23:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2207819059 learned_addr learned my addr 172.21.15.53:0/2207819059 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f3259b700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2c0c6920 0x7f5f2c0acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f767ffff700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7678035b10 0x7f76780cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2c0c6920 msgr2=0x7f5f2c0acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2c0c6920 0x7f5f2c0acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2207819059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c7b90 msgr2=0x7f5f2c0c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c7b90 0x7f5f2c0c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f5f32d9c700 1 -- 172.21.15.53:0/2207819059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0094f0 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f767ffff700 1 -- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678006c40 msgr2=0x7f76780fae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f767ffff700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678006c40 0x7f76780fae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f767ffff700 1 -- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f767800e350 msgr2=0x7f76780453a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T00:23:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f767ffff700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f767800e350 0x7f76780453a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.833+0000 7f767ffff700 1 -- 172.21.15.53:0/3156753876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680066410 con 0x7f7678035b10 2023-09-28T00:23:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7f5f32d9c700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 0x7f5f2c0c4b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009290 tx=0x7f5f1c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7fa2d6ffd700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa2bc0674b0 0x7fa2bc069960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00364a0 tx=0x7fa2c4017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7f767ffff700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7678035b10 0x7f76780cfbf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76800670a0 tx=0x7f768008a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680064990 con 0x7f7678035b10 2023-09-28T00:23:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76800633a0 con 0x7f7678035b10 2023-09-28T00:23:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768006a2e0 con 0x7f7678035b10 2023-09-28T00:23:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7f7684f9d700 1 -- 172.21.15.53:0/3156753876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76780fe240 con 0x7f7678035b10 2023-09-28T00:23:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.834+0000 7fc3add9d700 1 -- start start 2023-09-28T00:23:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.835+0000 7f7684f9d700 1 -- 172.21.15.53:0/3156753876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780fe800 con 0x7f7678035b10 2023-09-28T00:23:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.835+0000 7fc3add9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 0x7fc3a81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7fc3add9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 0x7fc3a814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7fc3acd9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 0x7fc3a81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7fc3acd9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 0x7fc3a81528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41224/0 (socket says 172.21.15.53:41224) 2023-09-28T00:23:08.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c011e60 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c01c670 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c01ca10 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7fc3a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 0x7fc3a814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.836+0000 7fc3a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 0x7fc3a814a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60846/0 (socket says 172.21.15.53:60846) 2023-09-28T00:23:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fc3acd9b700 1 -- 172.21.15.53:0/2780251590 learned_addr learned my addr 172.21.15.53:0/2780251590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fc3add9d700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3a80c4440 0x7fc3a8154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa2cc04a570 con 0x7fa2d0045840 2023-09-28T00:23:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c0ca330 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c0ca8f0 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76580052b0 con 0x7f7678035b10 2023-09-28T00:23:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8140e10 con 0x7fc3a806e910 2023-09-28T00:23:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fc3ad59c700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3a80c4440 0x7fc3a8154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8140940 con 0x7fc3a80c4440 2023-09-28T00:23:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8169dd0 con 0x7fc3a806dea0 2023-09-28T00:23:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.837+0000 7f4a8a5ff700 1 Processor -- start 2023-09-28T00:23:08.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7fc3acd9b700 1 -- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3a80c4440 msgr2=0x7fc3a8154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7fc3acd9b700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3a80c4440 0x7fc3a8154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7fc3acd9b700 1 -- 172.21.15.53:0/2780251590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 msgr2=0x7fc3a814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7fc3acd9b700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 0x7fc3a814a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7fc3acd9b700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009420 con 0x7fc3a806dea0 2023-09-28T00:23:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7fc3a7fff700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 0x7fc3a814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.839+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f768008d020 con 0x7f7678035b10 2023-09-28T00:23:08.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.838+0000 7f4a8a5ff700 1 -- start start 2023-09-28T00:23:08.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.840+0000 7f4a8a5ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4a840c7f60 0x7f4a841597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.840+0000 7f4a8a5ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840c8ba0 con 0x7f4a840c6920 2023-09-28T00:23:08.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.840+0000 7f4a8a5ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840c8e80 con 0x7f4a840c7b90 2023-09-28T00:23:08.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.840+0000 7f4a8a5ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a840c8990 con 0x7f4a840c7f60 2023-09-28T00:23:08.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.840+0000 7fc3acd9b700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 0x7fc3a81528e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c7f0 tx=0x7fc39c007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.840+0000 7f4a88b9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a840c6920 0x7f4a840699a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58600/0 (socket says 172.21.15.53:58600) 2023-09-28T00:23:08.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.841+0000 7f4a88b9c700 1 -- 172.21.15.53:0/1790057386 learned_addr learned my addr 172.21.15.53:0/1790057386 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:08.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.841+0000 7f766b7fe700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f76640674b0 0x7f7664069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.841+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f76800fd350 con 0x7f7678035b10 2023-09-28T00:23:08.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.841+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c005b30 con 0x7fc3a806dea0 2023-09-28T00:23:08.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c005c90 con 0x7fc3a806dea0 2023-09-28T00:23:08.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a837fe700 1 --2- 172.21.15.53:0/1790057386 >> v2:172.21.15.118:3300/0 conn(0x7f4a840c7f60 0x7f4a841597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043289492 0 0) 0x7f4a840c8e80 con 0x7f4a840c7b90 2023-09-28T00:23:08.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c003570 con 0x7f4a840c7b90 2023-09-28T00:23:08.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c004a80 con 0x7fc3a806dea0 2023-09-28T00:23:08.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a8152e20 con 0x7fc3a806dea0 2023-09-28T00:23:08.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858561453 0 0) 0x7f4a6c003570 con 0x7f4a840c7b90 2023-09-28T00:23:08.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 >> v2:172.21.15.118:3300/0 conn(0x7f4a840c7f60 msgr2=0x7f4a841597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 --2- 172.21.15.53:0/1790057386 >> v2:172.21.15.118:3300/0 conn(0x7f4a840c7f60 0x7f4a841597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 >> v1:172.21.15.53:6789/0 conn(0x7f4a840c6920 legacy=0x7f4a840699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840c9160 con 0x7f4a840c7b90 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 107228552 0 0) 0x7f4a7c001830 con 0x7f4a840c7b90 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.842+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 >> v1:172.21.15.118:6789/0 conn(0x7f4a840c7b90 legacy=0x7f4a8414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a82ffd700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a6c003a60 0x7f4a6c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a82ffd700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c004810 0x7f4a6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a82ffd700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a6c0051c0 0x7f4a6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840c8990 con 0x7f4a6c004810 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00c0d0 con 0x7f4a6c0051c0 2023-09-28T00:23:08.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00c290 con 0x7f4a6c003a60 2023-09-28T00:23:08.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a8169010 con 0x7fc3a806dea0 2023-09-28T00:23:08.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a837fe700 1 --2- 172.21.15.53:0/1790057386 >> v2:172.21.15.118:3300/0 conn(0x7f4a840c7f60 0x7f4a841597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:08.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a83fff700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a6c003a60 0x7f4a6c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f767f7fe700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f76640674b0 0x7f7664069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a83fff700 1 -- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a6c0051c0 msgr2=0x7f4a6c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a83fff700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a6c0051c0 0x7f4a6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f4a83fff700 1 -- 172.21.15.53:0/1790057386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c004810 msgr2=0x7f4a6c004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.844+0000 7f4a83fff700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c004810 0x7f4a6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.844+0000 7f4a83fff700 1 -- 172.21.15.53:0/1790057386 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840c9160 con 0x7f4a6c003a60 2023-09-28T00:23:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.844+0000 7f4a88b9c700 1 -- 172.21.15.53:0/1790057386 reap_dead start 2023-09-28T00:23:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.843+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c071830 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.846+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a804c3c0 con 0x7fc3a806dea0 2023-09-28T00:23:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.846+0000 7f4a83fff700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a6c003a60 0x7f4a6c003e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c610 tx=0x7f4a7c002e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3506580393181e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.847+0000 7f767f7fe700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f76640674b0 0x7f7664069960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f766c007fd0 tx=0x7f766c007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.847+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c016070 con 0x7f4a6c003a60 2023-09-28T00:23:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.847+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c006ba0 con 0x7f4a6c003a60 2023-09-28T00:23:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.847+0000 7f4a82ffd700 1 -- 172.21.15.53:0/1790057386 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c007020 con 0x7f4a6c003a60 2023-09-28T00:23:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.847+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5f1c01a450 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.848+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f76800ca2b0 con 0x7f7678035b10 2023-09-28T00:23:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.848+0000 7f5f227fc700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5f10067480 0x7f5f10069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.848+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f1c0875f0 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.849+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a6c003a60 msgr2=0x7f4a6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.849+0000 7f4a8a5ff700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a6c003a60 0x7f4a6c003e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c610 tx=0x7f4a7c002e60 comp rx=0 tx=0).stop 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.849+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/1790057386 shutdown_connections 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.849+0000 7f4a8a5ff700 1 --2- 172.21.15.53:0/1790057386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a6c003a60 0x7f4a6c003e70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.849+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/1790057386 >> 172.21.15.53:0/1790057386 conn(0x7f4a8406ed60 msgr2=0x7f4a8406f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.849+0000 7f5f3259b700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5f10067480 0x7f5f10069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.848+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc39c005030 con 0x7fc3a806dea0 2023-09-28T00:23:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.850+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5f1c054550 con 0x7f5f2c0c7f60 2023-09-28T00:23:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.850+0000 7fc3a4ff9700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc38c067400 0x7fc38c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.850+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc39c083e10 con 0x7fc3a806dea0 2023-09-28T00:23:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.851+0000 7fc3a7fff700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc38c067400 0x7fc38c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.851+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/1790057386 shutdown_connections 2023-09-28T00:23:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.851+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/1790057386 wait complete. 2023-09-28T00:23:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.852+0000 7f5f3259b700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5f10067480 0x7f5f10069930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f28003be0 tx=0x7f5f28007e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.853+0000 7fc3a7fff700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc38c067400 0x7fc38c0698b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3940093f0 tx=0x7fc394018000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.853+0000 7f4a8a5ff700 1 Processor -- start 2023-09-28T00:23:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.853+0000 7f4a8a5ff700 1 -- start start 2023-09-28T00:23:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.854+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc39c04b570 con 0x7fc3a806dea0 2023-09-28T00:23:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.855+0000 7f4a8a5ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 0x7f4a8414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.856+0000 7f4a8a5ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a8415a6c0 0x7f4a8416a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.856+0000 7f4a8a5ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 0x7f4a840c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.856+0000 7f4a83fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 0x7f4a8414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.856+0000 7f4a83fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 0x7f4a8414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60858/0 (socket says 172.21.15.53:60858) 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.857+0000 7f4a8a5ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8414de90 con 0x7f4a6c003a60 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.857+0000 7f4a88b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 0x7f4a840c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.857+0000 7f4a88b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 0x7f4a840c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34786/0 (socket says 172.21.15.53:34786) 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.857+0000 7f4a88b9c700 1 -- 172.21.15.53:0/2974089444 learned_addr learned my addr 172.21.15.53:0/2974089444 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.857+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8414cf00 con 0x7f4a8415d180 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.858+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8416aca0 con 0x7f4a8415a6c0 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.858+0000 7f4a837fe700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a8415a6c0 0x7f4a8416a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.859+0000 7f4a837fe700 1 -- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 msgr2=0x7f4a840c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.859+0000 7f4a837fe700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 0x7f4a840c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.859+0000 7f4a837fe700 1 -- 172.21.15.53:0/2974089444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 msgr2=0x7f4a8414d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.859+0000 7f4a837fe700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 0x7f4a8414d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.860+0000 7f4a837fe700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8415f910 con 0x7f4a8415a6c0 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.860+0000 7f4a83fff700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 0x7f4a8414d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.860+0000 7f4a88b9c700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 0x7f4a840c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.861+0000 7f4a837fe700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a8415a6c0 0x7f4a8416a760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400e820 tx=0x7f4a74008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.861+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a74013410 con 0x7f4a8415a6c0 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.862+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8415fbf0 con 0x7f4a8415a6c0 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.862+0000 7f4a8a5ff700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8414d150 con 0x7f4a8415a6c0 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.863+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a74013570 con 0x7f4a8415a6c0 2023-09-28T00:23:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.864+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a74013930 con 0x7f4a8415a6c0 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.871+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4a74013ca0 con 0x7f4a8415a6c0 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.873+0000 7f4a6bfff700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4a70067480 0x7f4a70069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.873+0000 7f4a83fff700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4a70067480 0x7f4a70069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.874+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a740848a0 con 0x7f4a8415a6c0 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.874+0000 7f4a83fff700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4a70067480 0x7f4a70069930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000f80 tx=0x7f4a7c016000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.874+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a84071830 con 0x7f4a8415a6c0 2023-09-28T00:23:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:08.880+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4a74051700 con 0x7f4a8415a6c0 2023-09-28T00:23:09.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.269+0000 7fa2c17fa700 1 -- 172.21.15.53:0/1497982094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa2b8005560 con 0x7fa2d0045840 2023-09-28T00:23:09.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.270+0000 7fa2c37fe700 1 -- 172.21.15.53:0/1497982094 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2cc016020 con 0x7fa2d0045840 2023-09-28T00:23:09.272 INFO:teuthology.orchestra.run.smithi053.stdout:60129542150 2023-09-28T00:23:09.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.273+0000 7f50cd19d700 1 -- 172.21.15.53:0/3589391087 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50c004f170 con 0x7f50c004f830 2023-09-28T00:23:09.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa2bc0674b0 msgr2=0x7fa2bc069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa2bc0674b0 0x7fa2bc069960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00364a0 tx=0x7fa2c4017000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2d0045840 msgr2=0x7fa2d0047eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2d0045840 0x7fa2d0047eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b5b0 tx=0x7fa2cc0090f0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7f50b3fff700 1 -- 172.21.15.53:0/3589391087 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50b4018070 con 0x7f50c004f830 2023-09-28T00:23:09.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 shutdown_connections 2023-09-28T00:23:09.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa2bc0674b0 0x7fa2bc069960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa2d0045840 0x7fa2d0047eb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2d004a4c0 0x7fa2d004f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 --2- 172.21.15.53:0/1497982094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d00dc4e0 0x7fa2d00de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.283 INFO:teuthology.orchestra.run.smithi053.stdout:64424509447 2023-09-28T00:23:09.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.274+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 >> 172.21.15.53:0/1497982094 conn(0x7fa2d000c050 msgr2=0x7fa2d00cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.275+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 shutdown_connections 2023-09-28T00:23:09.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.275+0000 7fa2ddbff700 1 -- 172.21.15.53:0/1497982094 wait complete. 2023-09-28T00:23:09.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.278+0000 7f50b1ffb700 1 -- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f50ac067480 msgr2=0x7f50ac069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.278+0000 7f50b1ffb700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f50ac067480 0x7f50ac069930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50c804d2d0 tx=0x7f50c806b040 comp rx=0 tx=0).stop 2023-09-28T00:23:09.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.278+0000 7fb1a37ff700 1 -- 172.21.15.53:0/3859639824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb19404b360 con 0x7fb194007700 2023-09-28T00:23:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.278+0000 7f50b1ffb700 1 -- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50c004f830 msgr2=0x7f50c004fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.278+0000 7f50b1ffb700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50c004f830 0x7f50c004fca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50c000cf80 tx=0x7f50b4008040 comp rx=0 tx=0).stop 2023-09-28T00:23:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7f50b1ffb700 1 -- 172.21.15.53:0/3589391087 shutdown_connections 2023-09-28T00:23:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7f50b1ffb700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f50ac067480 0x7f50ac069930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7f50b1ffb700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50c004f830 0x7f50c004fca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7f50b1ffb700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b8004810 0x7f50c00caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7f50b1ffb700 1 --2- 172.21.15.53:0/3589391087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c00e0c20 0x7f50c00e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7f50b1ffb700 1 -- 172.21.15.53:0/3589391087 >> 172.21.15.53:0/3589391087 conn(0x7f50c000bfc0 msgr2=0x7f50c0045270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.279+0000 7fb1917fa700 1 -- 172.21.15.53:0/3859639824 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb19c0cd970 con 0x7fb194007700 2023-09-28T00:23:09.288 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:09.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.283+0000 7f50b1ffb700 1 -- 172.21.15.53:0/3589391087 shutdown_connections 2023-09-28T00:23:09.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.283+0000 7f50b1ffb700 1 -- 172.21.15.53:0/3589391087 wait complete. 2023-09-28T00:23:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.284+0000 7fb186ffd700 1 -- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb1800673b0 msgr2=0x7fb180069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.284+0000 7fb186ffd700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb1800673b0 0x7fb180069860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1940d1af0 tx=0x7fb18c008040 comp rx=0 tx=0).stop 2023-09-28T00:23:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.284+0000 7fb186ffd700 1 -- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194007700 msgr2=0x7fb194034cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.284+0000 7fb186ffd700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194007700 0x7fb194034cd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb19c02b6c0 tx=0x7fb19c090000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.284+0000 7fb186ffd700 1 -- 172.21.15.53:0/3859639824 shutdown_connections 2023-09-28T00:23:09.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.285+0000 7fb186ffd700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb1800673b0 0x7fb180069860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.285+0000 7fb186ffd700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940d7500 0x7fb19404eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.285+0000 7fb186ffd700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194007700 0x7fb194034cd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.285+0000 7fb186ffd700 1 --2- 172.21.15.53:0/3859639824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19404be40 0x7fb19404e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.285+0000 7fb186ffd700 1 -- 172.21.15.53:0/3859639824 >> 172.21.15.53:0/3859639824 conn(0x7fb19400c050 msgr2=0x7fb1940e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.285+0000 7fb186ffd700 1 -- 172.21.15.53:0/3859639824 shutdown_connections 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.286+0000 7fb186ffd700 1 -- 172.21.15.53:0/3859639824 wait complete. 2023-09-28T00:23:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.291+0000 7f354359e700 1 -- 172.21.15.53:0/2554699383 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f353c038a50 con 0x7f353c0071b0 2023-09-28T00:23:09.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.292+0000 7f35327fc700 1 -- 172.21.15.53:0/2554699383 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3538056ba0 con 0x7f353c0071b0 2023-09-28T00:23:09.293 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.296+0000 7f3523fff700 1 -- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f35240674b0 msgr2=0x7f3524069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.296+0000 7f3523fff700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f35240674b0 0x7f3524069960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3534006fd0 tx=0x7f3534008040 comp rx=0 tx=0).stop 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.297+0000 7f3523fff700 1 -- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 msgr2=0x7f353c0ee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.297+0000 7f3523fff700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 0x7f353c0ee070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35380094c0 tx=0x7f3538017000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.297+0000 7f3523fff700 1 -- 172.21.15.53:0/2554699383 shutdown_connections 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.297+0000 7f3523fff700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f35240674b0 0x7f3524069960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.298+0000 7f3523fff700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353c0071b0 0x7f353c0ee070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.298+0000 7f3523fff700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353c0de850 0x7f353c0e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.298+0000 7f3523fff700 1 --2- 172.21.15.53:0/2554699383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f353c00f9d0 0x7f353c0da300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.298+0000 7f3523fff700 1 -- 172.21.15.53:0/2554699383 >> 172.21.15.53:0/2554699383 conn(0x7f353c051100 msgr2=0x7f353c038340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.298+0000 7f3523fff700 1 -- 172.21.15.53:0/2554699383 shutdown_connections 2023-09-28T00:23:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.299+0000 7f3523fff700 1 -- 172.21.15.53:0/2554699383 wait complete. 2023-09-28T00:23:09.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.300+0000 7fc3add9d700 1 -- 172.21.15.53:0/2780251590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc3a814b000 con 0x7fc3a806dea0 2023-09-28T00:23:09.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.300+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f2c071830 con 0x7f5f2c0c7f60 2023-09-28T00:23:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.300+0000 7fc3a4ff9700 1 -- 172.21.15.53:0/2780251590 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc39c050cf0 con 0x7fc3a806dea0 2023-09-28T00:23:09.301 INFO:teuthology.orchestra.run.smithi053.stdout:60129542150 2023-09-28T00:23:09.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.302+0000 7f5f227fc700 1 -- 172.21.15.53:0/2207819059 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f1c006cb0 con 0x7f5f2c0c7f60 2023-09-28T00:23:09.302 INFO:teuthology.orchestra.run.smithi053.stdout:64424509447 2023-09-28T00:23:09.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.305+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7658005830 con 0x7f7678035b10 2023-09-28T00:23:09.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7f766b7fe700 1 -- 172.21.15.53:0/3156753876 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76800cd8d0 con 0x7f7678035b10 2023-09-28T00:23:09.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7fc3927fc700 1 -- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc38c067400 msgr2=0x7fc38c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7fc3927fc700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc38c067400 0x7fc38c0698b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3940093f0 tx=0x7fc394018000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7fc3927fc700 1 -- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 msgr2=0x7fc3a81528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7fc3927fc700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 0x7fc3a81528e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c7f0 tx=0x7fc39c007f70 comp rx=0 tx=0).stop 2023-09-28T00:23:09.307 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5f10067480 msgr2=0x7f5f10069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.306+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5f10067480 0x7f5f10069930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f28003be0 tx=0x7f5f28007e20 comp rx=0 tx=0).stop 2023-09-28T00:23:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 msgr2=0x7f5f2c0c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 0x7f5f2c0c4b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009290 tx=0x7f5f1c016000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 shutdown_connections 2023-09-28T00:23:09.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5f10067480 0x7f5f10069930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f2c0c6920 0x7f5f2c0acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f2c0c7f60 0x7f5f2c0c4b40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 --2- 172.21.15.53:0/2207819059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f2c0c7b90 0x7f5f2c0c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 >> 172.21.15.53:0/2207819059 conn(0x7f5f2c06ed60 msgr2=0x7f5f2c156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7fc3927fc700 1 -- 172.21.15.53:0/2780251590 shutdown_connections 2023-09-28T00:23:09.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7fc3927fc700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc38c067400 0x7fc38c0698b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7fc3927fc700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3a806dea0 0x7fc3a81528e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7fc3927fc700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3a80c4440 0x7fc3a8154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7fc3927fc700 1 --2- 172.21.15.53:0/2780251590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a806e910 0x7fc3a814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.307+0000 7fc3927fc700 1 -- 172.21.15.53:0/2780251590 >> 172.21.15.53:0/2780251590 conn(0x7fc3a8067630 msgr2=0x7fc3a8150980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.308+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 shutdown_connections 2023-09-28T00:23:09.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.308+0000 7f5f347ff700 1 -- 172.21.15.53:0/2207819059 wait complete. 2023-09-28T00:23:09.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.308+0000 7fc3927fc700 1 -- 172.21.15.53:0/2780251590 shutdown_connections 2023-09-28T00:23:09.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.308+0000 7fc3927fc700 1 -- 172.21.15.53:0/2780251590 wait complete. 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.309+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f76640674b0 msgr2=0x7f7664069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.309+0000 7f76697fa700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f76640674b0 0x7f7664069960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f766c007fd0 tx=0x7f766c007d50 comp rx=0 tx=0).stop 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7678035b10 msgr2=0x7f76780cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7678035b10 0x7f76780cfbf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76800670a0 tx=0x7f768008a000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 shutdown_connections 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f76640674b0 0x7f7664069960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7678006c40 0x7f76780fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7678035b10 0x7f76780cfbf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 --2- 172.21.15.53:0/3156753876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f767800e350 0x7f76780453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.310+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 >> 172.21.15.53:0/3156753876 conn(0x7f767800bea0 msgr2=0x7f7678033670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.311+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 shutdown_connections 2023-09-28T00:23:09.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.311+0000 7f76697fa700 1 -- 172.21.15.53:0/3156753876 wait complete. 2023-09-28T00:23:09.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2023-09-28T00:23:09.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2023-09-28T00:23:09.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.321+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a840c9440 con 0x7f4a8415a6c0 2023-09-28T00:23:09.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.322+0000 7f4a6bfff700 1 -- 172.21.15.53:0/2974089444 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a74021090 con 0x7f4a8415a6c0 2023-09-28T00:23:09.322 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:09.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2023-09-28T00:23:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4a70067480 msgr2=0x7f4a70069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4a70067480 0x7f4a70069930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000f80 tx=0x7f4a7c016000 comp rx=0 tx=0).stop 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a8415a6c0 msgr2=0x7f4a8416a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a8415a6c0 0x7f4a8416a760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400e820 tx=0x7f4a74008040 comp rx=0 tx=0).stop 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 shutdown_connections 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4a70067480 0x7f4a70069930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a8415d180 0x7f4a840c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c003a60 0x7f4a8414d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 --2- 172.21.15.53:0/2974089444 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4a8415a6c0 0x7f4a8416a760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.325+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 >> 172.21.15.53:0/2974089444 conn(0x7f4a8406ed60 msgr2=0x7f4a840caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:09.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.326+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 shutdown_connections 2023-09-28T00:23:09.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:09.326+0000 7f4a69ffb700 1 -- 172.21.15.53:0/2974089444 wait complete. 2023-09-28T00:23:09.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2023-09-28T00:23:09.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2023-09-28T00:23:09.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2023-09-28T00:23:09.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2023-09-28T00:23:09.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.3 2023-09-28T00:23:10.305 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-09-28T00:23:10.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-09-28T00:23:10.305 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-09-28T00:23:10.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-09-28T00:23:10.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-28T00:23:10.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T00:23:10.324 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-28T00:23:10.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T00:23:10.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-28T00:23:10.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T00:23:10.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-28T00:23:10.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-28T00:23:10.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.623+0000 7fbc17fff700 1 Processor -- start 2023-09-28T00:23:10.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.624+0000 7fbc17fff700 1 -- start start 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.625+0000 7fbc17fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc10039f10 0x7fbc100debb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc17fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc10010fd0 0x7fbc1004f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc17fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1004f110 0x7fbc1004feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc17fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc10037490 con 0x7fbc10039f10 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc17fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc10037770 con 0x7fbc10010fd0 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc17fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10037a50 con 0x7fbc1004f110 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc177fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1004f110 0x7fbc1004feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc177fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1004f110 0x7fbc1004feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41256/0 (socket says 172.21.15.53:41256) 2023-09-28T00:23:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.626+0000 7fbc177fe700 1 -- 172.21.15.53:0/4179330813 learned_addr learned my addr 172.21.15.53:0/4179330813 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.627+0000 7fbc167fc700 1 --2- 172.21.15.53:0/4179330813 >> v2:172.21.15.118:3300/0 conn(0x7fbc10010fd0 0x7fbc1004f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.627+0000 7fbc167fc700 1 -- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1004f110 msgr2=0x7fbc1004feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.627+0000 7fbc167fc700 1 --2- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1004f110 0x7fbc1004feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.627+0000 7fbc167fc700 1 -- 172.21.15.53:0/4179330813 >> v2:172.21.15.53:3300/0 conn(0x7fbc10039f10 msgr2=0x7fbc100debb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.627+0000 7fbc16ffd700 1 --2- 172.21.15.53:0/4179330813 >> v2:172.21.15.53:3300/0 conn(0x7fbc10039f10 0x7fbc100debb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.628+0000 7fbc167fc700 1 --2- 172.21.15.53:0/4179330813 >> v2:172.21.15.53:3300/0 conn(0x7fbc10039f10 0x7fbc100debb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.628+0000 7fbc167fc700 1 -- 172.21.15.53:0/4179330813 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10037d30 con 0x7fbc10010fd0 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.628+0000 7fbc16ffd700 1 --2- 172.21.15.53:0/4179330813 >> v2:172.21.15.53:3300/0 conn(0x7fbc10039f10 0x7fbc100debb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.628+0000 7fbc167fc700 1 --2- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc1004f970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbc100060f0 tx=0x7fbc080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad61446ce43954c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.629+0000 7fbc15ffb700 1 -- 172.21.15.53:0/4179330813 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800b740 con 0x7fbc10010fd0 2023-09-28T00:23:10.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.629+0000 7fbc15ffb700 1 -- 172.21.15.53:0/4179330813 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800b8a0 con 0x7fbc10010fd0 2023-09-28T00:23:10.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.630+0000 7fbc17fff700 1 -- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 msgr2=0x7fbc1004f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.630+0000 7fbc17fff700 1 --2- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc1004f970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbc100060f0 tx=0x7fbc080091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 -- 172.21.15.53:0/4179330813 shutdown_connections 2023-09-28T00:23:10.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 --2- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc1004f110 0x7fbc1004feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 --2- 172.21.15.53:0/4179330813 >> v2:172.21.15.53:3300/0 conn(0x7fbc10039f10 0x7fbc100debb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 --2- 172.21.15.53:0/4179330813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc1004f970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 -- 172.21.15.53:0/4179330813 >> 172.21.15.53:0/4179330813 conn(0x7fbc10051cb0 msgr2=0x7fbc10010360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 -- 172.21.15.53:0/4179330813 shutdown_connections 2023-09-28T00:23:10.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.631+0000 7fbc17fff700 1 -- 172.21.15.53:0/4179330813 wait complete. 2023-09-28T00:23:10.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.634+0000 7fbc17fff700 1 Processor -- start 2023-09-28T00:23:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.635+0000 7f04fe99d700 1 Processor -- start 2023-09-28T00:23:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.635+0000 7fbc17fff700 1 -- start start 2023-09-28T00:23:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.636+0000 7fbc17fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc10048a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.636+0000 7fbc17fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 0x7fbc1004a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.637+0000 7fbc16ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc10048a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.637+0000 7fbc16ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc10048a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34818/0 (socket says 172.21.15.53:34818) 2023-09-28T00:23:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.637+0000 7fbc17fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1004f110 0x7fbc100d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.637+0000 7fbc167fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 0x7fbc1004a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7fbc167fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 0x7fbc1004a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41260/0 (socket says 172.21.15.53:41260) 2023-09-28T00:23:10.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7fbc17fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100e9f40 con 0x7fbc1004f110 2023-09-28T00:23:10.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7fbc17fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100ea220 con 0x7fbc10010fd0 2023-09-28T00:23:10.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7fbc17fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100ea500 con 0x7fbc10039f10 2023-09-28T00:23:10.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7fbc16ffd700 1 -- 172.21.15.53:0/1061015576 learned_addr learned my addr 172.21.15.53:0/1061015576 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7fbc177fe700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1004f110 0x7fbc100d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.635+0000 7f04fe99d700 1 -- start start 2023-09-28T00:23:10.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.637+0000 7f04fe99d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f04f0045a30 0x7f04f00de050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7f04fe99d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04f004ad30 0x7f04f00d3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7f04fe99d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f004b1e0 con 0x7f04f00076b0 2023-09-28T00:23:10.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7f04fe99d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00de590 con 0x7f04f004ad30 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7f04fe99d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00daec0 con 0x7f04f0045a30 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.638+0000 7f04fd19a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04f004ad30 0x7f04f00d3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7f04fd19a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04f004ad30 0x7f04f00d3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60874/0 (socket says 172.21.15.53:60874) 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7f04fd19a700 1 -- 172.21.15.53:0/1381145969 learned_addr learned my addr 172.21.15.53:0/1381145969 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7f04fd19a700 1 -- 172.21.15.53:0/1381145969 >> v2:172.21.15.118:3300/0 conn(0x7f04f0045a30 msgr2=0x7f04f00de050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7f04fd19a700 1 --2- 172.21.15.53:0/1381145969 >> v2:172.21.15.118:3300/0 conn(0x7f04f0045a30 0x7f04f00de050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7f04fd19a700 1 -- 172.21.15.53:0/1381145969 >> v1:172.21.15.118:6789/0 conn(0x7f04f00076b0 legacy=0x7f04f00db740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7f04fd19a700 1 -- 172.21.15.53:0/1381145969 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00da2b0 con 0x7f04f004ad30 2023-09-28T00:23:10.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.640+0000 7f04fd19a700 1 --2- 172.21.15.53:0/1381145969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f004ad30 0x7f04f00d3ee0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f802b6c0 tx=0x7f04f8066630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3a985b58eaa373 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7fbc167fc700 1 -- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 msgr2=0x7fbc10048a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7fbc167fc700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc10048a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7fbc167fc700 1 -- 172.21.15.53:0/1061015576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1004f110 msgr2=0x7fbc100d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7fbc167fc700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1004f110 0x7fbc100d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.639+0000 7fbc167fc700 1 -- 172.21.15.53:0/1061015576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08009420 con 0x7fbc10039f10 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.640+0000 7fbc167fc700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 0x7fbc1004a720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbc08016000 tx=0x7fbc08017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.641+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0801f070 con 0x7fbc10039f10 2023-09-28T00:23:10.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.641+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0801adb0 con 0x7fbc10039f10 2023-09-28T00:23:10.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.642+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc100ea7e0 con 0x7fbc10039f10 2023-09-28T00:23:10.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.642+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc10049d40 con 0x7fbc10039f10 2023-09-28T00:23:10.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.644+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08025670 con 0x7fbc10039f10 2023-09-28T00:23:10.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.644+0000 7f04fc999700 1 -- 172.21.15.53:0/1381145969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8064920 con 0x7f04f004ad30 2023-09-28T00:23:10.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.644+0000 7f04fc999700 1 -- 172.21.15.53:0/1381145969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8063230 con 0x7f04f004ad30 2023-09-28T00:23:10.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.645+0000 7f04fe99d700 1 -- 172.21.15.53:0/1381145969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f004ad30 msgr2=0x7f04f00d3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.646+0000 7f04fe99d700 1 --2- 172.21.15.53:0/1381145969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f004ad30 0x7f04f00d3ee0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f802b6c0 tx=0x7f04f8066630 comp rx=0 tx=0).stop 2023-09-28T00:23:10.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.646+0000 7f04fe99d700 1 -- 172.21.15.53:0/1381145969 shutdown_connections 2023-09-28T00:23:10.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.646+0000 7f04fe99d700 1 --2- 172.21.15.53:0/1381145969 >> v2:172.21.15.118:3300/0 conn(0x7f04f0045a30 0x7f04f00de050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.646+0000 7f04fe99d700 1 --2- 172.21.15.53:0/1381145969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f004ad30 0x7f04f00d3ee0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.646+0000 7f04fe99d700 1 -- 172.21.15.53:0/1381145969 >> 172.21.15.53:0/1381145969 conn(0x7f04f000bfc0 msgr2=0x7f04f000c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.646+0000 7f04fe99d700 1 -- 172.21.15.53:0/1381145969 shutdown_connections 2023-09-28T00:23:10.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.644+0000 7fbc04ff9700 1 -- 172.21.15.53:0/1061015576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf80052b0 con 0x7fbc10039f10 2023-09-28T00:23:10.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.647+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbc08023070 con 0x7fbc10039f10 2023-09-28T00:23:10.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.647+0000 7f04fe99d700 1 -- 172.21.15.53:0/1381145969 wait complete. 2023-09-28T00:23:10.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.649+0000 7fbc06ffd700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbbfc0673d0 0x7fbbfc069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.649+0000 7f04fe99d700 1 Processor -- start 2023-09-28T00:23:10.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.649+0000 7fbc16ffd700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbbfc0673d0 0x7fbbfc069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.650+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc08086190 con 0x7fbc10039f10 2023-09-28T00:23:10.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.650+0000 7fbc16ffd700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbbfc0673d0 0x7fbbfc069880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006fd0 tx=0x7fbc0c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.649+0000 7f04fe99d700 1 -- start start 2023-09-28T00:23:10.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7f04fe99d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f00076b0 0x7f04f00474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7f04fe99d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f0045a30 0x7f04f0050370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7f04fd99b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f00076b0 0x7f04f00474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7f04fd99b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f00076b0 0x7f04f00474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41272/0 (socket says 172.21.15.53:41272) 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.648+0000 7efee99ff700 1 Processor -- start 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.649+0000 7efee99ff700 1 -- start start 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee99ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efedc0456f0 0x7efedc0e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee99ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc006e30 con 0x7efedc0dbf50 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee99ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc005fc0 con 0x7efedc045320 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee99ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc045ac0 con 0x7efedc0456f0 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee27fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efedc0456f0 0x7efedc0e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee27fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efedc0456f0 0x7efedc0e2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34832/0 (socket says 172.21.15.53:34832) 2023-09-28T00:23:10.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.651+0000 7efee27fc700 1 -- 172.21.15.53:0/487762182 learned_addr learned my addr 172.21.15.53:0/487762182 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.652+0000 7f04fd99b700 1 -- 172.21.15.53:0/1321516607 learned_addr learned my addr 172.21.15.53:0/1321516607 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.652+0000 7f04fd19a700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f0045a30 0x7f04f0050370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.653+0000 7f04fe99d700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f0050dc0 0x7f04f004c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.653+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbc08053130 con 0x7fbc10039f10 2023-09-28T00:23:10.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.653+0000 7efee27fc700 1 -- 172.21.15.53:0/487762182 >> v1:172.21.15.118:6789/0 conn(0x7efedc045320 legacy=0x7efedc007130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.653+0000 7efee27fc700 1 -- 172.21.15.53:0/487762182 >> v1:172.21.15.53:6789/0 conn(0x7efedc0dbf50 legacy=0x7efedc04b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.653+0000 7efee27fc700 1 -- 172.21.15.53:0/487762182 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc006260 con 0x7efedc0456f0 2023-09-28T00:23:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.654+0000 7efee27fc700 1 --2- 172.21.15.53:0/487762182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0456f0 0x7efedc0e2cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efed80099b0 tx=0x7efed8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c898cc602cc39200 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.654+0000 7f04fe99d700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0035d60 con 0x7f04f0050dc0 2023-09-28T00:23:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.654+0000 7f04fe99d700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f004e670 con 0x7f04f0045a30 2023-09-28T00:23:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.654+0000 7f04fe99d700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00355f0 con 0x7f04f00076b0 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.654+0000 7f04fe19c700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f0050dc0 0x7f04f004c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.655+0000 7f04fd19a700 1 -- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f00076b0 msgr2=0x7f04f00474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.655+0000 7f04fd19a700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f00076b0 0x7f04f00474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.655+0000 7f04fd19a700 1 -- 172.21.15.53:0/1321516607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f0050dc0 msgr2=0x7f04f004c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.655+0000 7f04fd19a700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f0050dc0 0x7f04f004c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.655+0000 7f04fd19a700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8066410 con 0x7f04f0045a30 2023-09-28T00:23:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.655+0000 7f04fe19c700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f0050dc0 0x7f04f004c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:10.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.656+0000 7efee1ffb700 1 -- 172.21.15.53:0/487762182 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800b760 con 0x7efedc0456f0 2023-09-28T00:23:10.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.656+0000 7efee1ffb700 1 -- 172.21.15.53:0/487762182 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed800b8c0 con 0x7efedc0456f0 2023-09-28T00:23:10.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.656+0000 7efee1ffb700 1 -- 172.21.15.53:0/487762182 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800bc40 con 0x7efedc0456f0 2023-09-28T00:23:10.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.656+0000 7f04fd19a700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f0045a30 0x7f04f0050370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04f80670a0 tx=0x7f04f806c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.657+0000 7efee99ff700 1 -- 172.21.15.53:0/487762182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0456f0 msgr2=0x7efedc0e2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.657+0000 7efee99ff700 1 --2- 172.21.15.53:0/487762182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0456f0 0x7efedc0e2cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efed80099b0 tx=0x7efed8009250 comp rx=0 tx=0).stop 2023-09-28T00:23:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.657+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8063230 con 0x7f04f0045a30 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.657+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8064920 con 0x7f04f0045a30 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.657+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f808f620 con 0x7f04f0045a30 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.658+0000 7f04fe99d700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f00358d0 con 0x7f04f0045a30 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.658+0000 7f04fe99d700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f00508b0 con 0x7f04f0045a30 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.658+0000 7efee99ff700 1 -- 172.21.15.53:0/487762182 shutdown_connections 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.659+0000 7efee99ff700 1 --2- 172.21.15.53:0/487762182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0456f0 0x7efedc0e2cb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.659+0000 7efee99ff700 1 -- 172.21.15.53:0/487762182 >> 172.21.15.53:0/487762182 conn(0x7efedc00beb0 msgr2=0x7efedc00c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.660+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40052b0 con 0x7f04f0045a30 2023-09-28T00:23:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.662+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f04f808d020 con 0x7f04f0045a30 2023-09-28T00:23:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.664+0000 7efee99ff700 1 -- 172.21.15.53:0/487762182 shutdown_connections 2023-09-28T00:23:10.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.665+0000 7f04edffb700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f04dc067480 0x7f04dc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.665+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f04f80fc620 con 0x7f04f0045a30 2023-09-28T00:23:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.666+0000 7f04fd99b700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f04dc067480 0x7f04dc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.664+0000 7efee99ff700 1 -- 172.21.15.53:0/487762182 wait complete. 2023-09-28T00:23:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.666+0000 7efee99ff700 1 Processor -- start 2023-09-28T00:23:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.666+0000 7efee99ff700 1 -- start start 2023-09-28T00:23:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.667+0000 7f04fd99b700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f04dc067480 0x7f04dc069930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009bd0 tx=0x7f04f40090f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.668+0000 7efee99ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 0x7efedc0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.668+0000 7efee99ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efedc0456f0 0x7efedc0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.668+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f04f80c9500 con 0x7f04f0045a30 2023-09-28T00:23:10.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.668+0000 7efee2ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 0x7efedc0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.668+0000 7efee2ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 0x7efedc0c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41288/0 (socket says 172.21.15.53:41288) 2023-09-28T00:23:10.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.669+0000 7efee2ffd700 1 -- 172.21.15.53:0/801019768 learned_addr learned my addr 172.21.15.53:0/801019768 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.669+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0dbf50 0x7efedc0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.669+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc0c58d0 con 0x7efedc0456f0 2023-09-28T00:23:10.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.669+0000 7efee37fe700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0dbf50 0x7efedc0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc04e090 con 0x7efedc0dbf50 2023-09-28T00:23:10.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc04efa0 con 0x7efedc045320 2023-09-28T00:23:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee2ffd700 1 -- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0dbf50 msgr2=0x7efedc0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee2ffd700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0dbf50 0x7efedc0caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee2ffd700 1 -- 172.21.15.53:0/801019768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efedc0456f0 msgr2=0x7efedc0ca960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee2ffd700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efedc0456f0 0x7efedc0ca960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.670+0000 7efee2ffd700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80094f0 con 0x7efedc045320 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.671+0000 7efee2ffd700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 0x7efedc0c5390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efee404d1b0 tx=0x7efee4066740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.671+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4069aa0 con 0x7efedc045320 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.671+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4069c00 con 0x7efedc045320 2023-09-28T00:23:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.671+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4063a50 con 0x7efedc045320 2023-09-28T00:23:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.672+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc04e2c0 con 0x7efedc045320 2023-09-28T00:23:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.673+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc0e1c00 con 0x7efedc045320 2023-09-28T00:23:10.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.676+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efee407c070 con 0x7efedc045320 2023-09-28T00:23:10.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.678+0000 7efecaffd700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efed0067480 0x7efed0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.678+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efee40ead30 con 0x7efedc045320 2023-09-28T00:23:10.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.680+0000 7efee27fc700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efed0067480 0x7efed0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.681+0000 7efec8ff9700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40052b0 con 0x7efedc045320 2023-09-28T00:23:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.682+0000 7efee27fc700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efed0067480 0x7efed0069930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efed80099b0 tx=0x7efed8016000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.686+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efee40bb6a0 con 0x7efedc045320 2023-09-28T00:23:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.711+0000 7fea247ff700 1 Processor -- start 2023-09-28T00:23:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.711+0000 7fea247ff700 1 -- start start 2023-09-28T00:23:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fea247ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea14050270 0x7fea14047470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fea247ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea14037ed0 0x7fea140479b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fea247ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea140e3410 con 0x7fea14039e00 2023-09-28T00:23:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fea247ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea14007b70 con 0x7fea14050270 2023-09-28T00:23:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fea247ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140395c0 con 0x7fea14037ed0 2023-09-28T00:23:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fea21d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea14050270 0x7fea14047470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fea22d9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea14037ed0 0x7fea140479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fea21d9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea14050270 0x7fea14047470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60904/0 (socket says 172.21.15.53:60904) 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fea22d9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea14037ed0 0x7fea140479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34868/0 (socket says 172.21.15.53:34868) 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fea21d9a700 1 -- 172.21.15.53:0/3908993493 learned_addr learned my addr 172.21.15.53:0/3908993493 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fea21d9a700 1 -- 172.21.15.53:0/3908993493 >> v2:172.21.15.118:3300/0 conn(0x7fea14037ed0 msgr2=0x7fea140479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fea21d9a700 1 --2- 172.21.15.53:0/3908993493 >> v2:172.21.15.118:3300/0 conn(0x7fea14037ed0 0x7fea140479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fea21d9a700 1 -- 172.21.15.53:0/3908993493 >> v1:172.21.15.53:6789/0 conn(0x7fea14039e00 legacy=0x7fea140377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fea21d9a700 1 -- 172.21.15.53:0/3908993493 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14047ef0 con 0x7fea14050270 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.710+0000 7fa3affff700 1 Processor -- start 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.710+0000 7fa3affff700 1 -- start start 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.712+0000 7fa3affff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3a8045430 0x7fa3a80e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.712+0000 7fa3affff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3a80dc060 0x7fa3a80dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.712+0000 7fa3affff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8006f40 con 0x7fa3a8045800 2023-09-28T00:23:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.712+0000 7fa3affff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a8045bd0 con 0x7fa3a80dc060 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.712+0000 7fa3affff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80e3300 con 0x7fa3a8045430 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.713+0000 7fa3ae7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa3a8045800 0x7fa3a8007240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54396/0 (socket says 172.21.15.53:54396) 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.713+0000 7fa3ae7fc700 1 -- 172.21.15.53:0/3835682713 learned_addr learned my addr 172.21.15.53:0/3835682713 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.713+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/3835682713 >> v2:172.21.15.118:3300/0 conn(0x7fa3a8045430 0x7fa3a80e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.713+0000 7fa3af7fe700 1 --2- 172.21.15.53:0/3835682713 >> v2:172.21.15.53:3300/0 conn(0x7fa3a80dc060 0x7fa3a80dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fa3aeffd700 1 -- 172.21.15.53:0/3835682713 >> v2:172.21.15.53:3300/0 conn(0x7fa3a80dc060 msgr2=0x7fa3a80dc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/3835682713 >> v2:172.21.15.53:3300/0 conn(0x7fa3a80dc060 0x7fa3a80dc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fa3aeffd700 1 -- 172.21.15.53:0/3835682713 >> v1:172.21.15.118:6789/0 conn(0x7fa3a8045800 legacy=0x7fa3a8007240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fa3aeffd700 1 -- 172.21.15.53:0/3835682713 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80dc9e0 con 0x7fa3a8045430 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.714+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/3835682713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a8045430 0x7fa3a80e2dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800ddd0 tx=0x7fa3a4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdf5df91babab1e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fa3adffb700 1 -- 172.21.15.53:0/3835682713 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011630 con 0x7fa3a8045430 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fa3adffb700 1 -- 172.21.15.53:0/3835682713 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4011790 con 0x7fa3a8045430 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.715+0000 7fa3adffb700 1 -- 172.21.15.53:0/3835682713 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011b10 con 0x7fa3a8045430 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fa3affff700 1 -- 172.21.15.53:0/3835682713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a8045430 msgr2=0x7fa3a80e2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fa3affff700 1 --2- 172.21.15.53:0/3835682713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a8045430 0x7fa3a80e2dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800ddd0 tx=0x7fa3a4009120 comp rx=0 tx=0).stop 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fa3affff700 1 -- 172.21.15.53:0/3835682713 shutdown_connections 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fa3affff700 1 --2- 172.21.15.53:0/3835682713 >> v2:172.21.15.53:3300/0 conn(0x7fa3a80dc060 0x7fa3a80dc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fa3affff700 1 --2- 172.21.15.53:0/3835682713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a8045430 0x7fa3a80e2dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.716+0000 7fa3affff700 1 -- 172.21.15.53:0/3835682713 >> 172.21.15.53:0/3835682713 conn(0x7fa3a800bfc0 msgr2=0x7fa3a800c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.717+0000 7fea21d9a700 1 --2- 172.21.15.53:0/3908993493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14050270 0x7fea14047470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea1c02b6c0 tx=0x7fea1c066740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90b99724ce26b8a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.717+0000 7fa3affff700 1 -- 172.21.15.53:0/3835682713 shutdown_connections 2023-09-28T00:23:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.717+0000 7fa3affff700 1 -- 172.21.15.53:0/3835682713 wait complete. 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.717+0000 7fea21599700 1 -- 172.21.15.53:0/3908993493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c04c3c0 con 0x7fea14050270 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.717+0000 7fea21599700 1 -- 172.21.15.53:0/3908993493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c063230 con 0x7fea14050270 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.718+0000 7fea21599700 1 -- 172.21.15.53:0/3908993493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0633e0 con 0x7fea14050270 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.719+0000 7fea247ff700 1 -- 172.21.15.53:0/3908993493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14050270 msgr2=0x7fea14047470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.719+0000 7fea247ff700 1 --2- 172.21.15.53:0/3908993493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14050270 0x7fea14047470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea1c02b6c0 tx=0x7fea1c066740 comp rx=0 tx=0).stop 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.719+0000 7fea247ff700 1 -- 172.21.15.53:0/3908993493 shutdown_connections 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.719+0000 7fea247ff700 1 --2- 172.21.15.53:0/3908993493 >> v2:172.21.15.118:3300/0 conn(0x7fea14037ed0 0x7fea140479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.719+0000 7fea247ff700 1 --2- 172.21.15.53:0/3908993493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14050270 0x7fea14047470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.719+0000 7fea247ff700 1 -- 172.21.15.53:0/3908993493 >> 172.21.15.53:0/3908993493 conn(0x7fea14051ba0 msgr2=0x7fea14010250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.720+0000 7fea247ff700 1 -- 172.21.15.53:0/3908993493 shutdown_connections 2023-09-28T00:23:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.720+0000 7fea247ff700 1 -- 172.21.15.53:0/3908993493 wait complete. 2023-09-28T00:23:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.720+0000 7fa3affff700 1 Processor -- start 2023-09-28T00:23:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.720+0000 7fa3affff700 1 -- start start 2023-09-28T00:23:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.722+0000 7fa3affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a8045430 0x7fa3a80c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.722+0000 7fa3affff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3a8045800 0x7fa3a80d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.722+0000 7fa3affff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a80dc060 0x7fa3a80d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fea247ff700 1 Processor -- start 2023-09-28T00:23:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3affff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80cf4b0 con 0x7fa3a8045430 2023-09-28T00:23:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3affff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80cf790 con 0x7fa3a80dc060 2023-09-28T00:23:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3affff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80cfa70 con 0x7fa3a8045800 2023-09-28T00:23:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fea247ff700 1 -- start start 2023-09-28T00:23:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3af7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a80dc060 0x7fa3a80d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3af7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a80dc060 0x7fa3a80d2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34870/0 (socket says 172.21.15.53:34870) 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3af7fe700 1 -- 172.21.15.53:0/4139206449 learned_addr learned my addr 172.21.15.53:0/4139206449 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.723+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a8045430 0x7fa3a80c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3ae7fc700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3a8045800 0x7fa3a80d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3aeffd700 1 -- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3a8045800 msgr2=0x7fa3a80d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3a8045800 0x7fa3a80d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3aeffd700 1 -- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a80dc060 msgr2=0x7fa3a80d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a80dc060 0x7fa3a80d2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3aeffd700 1 -- 172.21.15.53:0/4139206449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40093c0 con 0x7fa3a8045430 2023-09-28T00:23:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.724+0000 7fa3ae7fc700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3a8045800 0x7fa3a80d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:23:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.725+0000 7fa3aeffd700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a8045430 0x7fa3a80c5cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800ddd0 tx=0x7fa3a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.725+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011b10 con 0x7fa3a8045430 2023-09-28T00:23:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.725+0000 7fea247ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14037ed0 0x7fea14049050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4020070 con 0x7fa3a8045430 2023-09-28T00:23:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40276d0 con 0x7fa3a8045430 2023-09-28T00:23:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80cfd50 con 0x7fa3a8045430 2023-09-28T00:23:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a80cf1c0 con 0x7fa3a8045430 2023-09-28T00:23:10.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7f37109ff700 1 Processor -- start 2023-09-28T00:23:10.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7f37109ff700 1 -- start start 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7fea247ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea14039e00 0x7fea14052a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.726+0000 7fea247ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14050270 0x7fea14052f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea247ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140cc660 con 0x7fea14037ed0 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea247ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140cbd70 con 0x7fea14039e00 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea247ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140ccaf0 con 0x7fea14050270 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea21d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea14039e00 0x7fea14052a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea22d9c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14050270 0x7fea14052f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea22d9c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14050270 0x7fea14052f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41306/0 (socket says 172.21.15.53:41306) 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.727+0000 7fea22d9c700 1 -- 172.21.15.53:0/3632921257 learned_addr learned my addr 172.21.15.53:0/3632921257 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.728+0000 7fea2259b700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14037ed0 0x7fea14049050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7fea21d9a700 1 -- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14050270 msgr2=0x7fea14052f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7fea21d9a700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14050270 0x7fea14052f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7fea21d9a700 1 -- 172.21.15.53:0/3632921257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14037ed0 msgr2=0x7fea14049050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7fea21d9a700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14037ed0 0x7fea14049050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7fea21d9a700 1 -- 172.21.15.53:0/3632921257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c066410 con 0x7fea14039e00 2023-09-28T00:23:10.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7fea2259b700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14037ed0 0x7fea14049050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:10.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.730+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa3a4027a40 con 0x7fa3a8045430 2023-09-28T00:23:10.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.730+0000 7fea21d9a700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea14039e00 0x7fea14052a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea1c04d1b0 tx=0x7fea1c08c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7f37109ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 0x7f370c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7f37109ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f370c15d480 0x7f370c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7f37109ff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c15cff0 con 0x7f370c06a640 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7f37109ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0c3db0 con 0x7f370c15d480 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.729+0000 7f37109ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c159a30 con 0x7f370c1570d0 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.730+0000 7f370a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 0x7f370c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.730+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c097070 con 0x7fea14039e00 2023-09-28T00:23:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.730+0000 7f370a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 0x7f370c06e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41310/0 (socket says 172.21.15.53:41310) 2023-09-28T00:23:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.730+0000 7f370a59c700 1 -- 172.21.15.53:0/825032460 learned_addr learned my addr 172.21.15.53:0/825032460 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.731+0000 7fea247ff700 1 -- 172.21.15.53:0/3632921257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1404be30 con 0x7fea14039e00 2023-09-28T00:23:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.731+0000 7f370a59c700 1 -- 172.21.15.53:0/825032460 >> v2:172.21.15.118:3300/0 conn(0x7f370c15d480 msgr2=0x7f370c15d900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T00:23:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.731+0000 7f370a59c700 1 --2- 172.21.15.53:0/825032460 >> v2:172.21.15.118:3300/0 conn(0x7f370c15d480 0x7f370c15d900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.732+0000 7fea247ff700 1 -- 172.21.15.53:0/3632921257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea140cc2f0 con 0x7fea14039e00 2023-09-28T00:23:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.731+0000 7f370a59c700 1 -- 172.21.15.53:0/825032460 >> v1:172.21.15.53:6789/0 conn(0x7f370c06a640 legacy=0x7f370c0699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.731+0000 7f370a59c700 1 -- 172.21.15.53:0/825032460 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c15de40 con 0x7f370c1570d0 2023-09-28T00:23:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.731+0000 7f370a59c700 1 --2- 172.21.15.53:0/825032460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 0x7f370c06e660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37000099b0 tx=0x7f3700009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ad2dc1047a5831 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.732+0000 7f370959a700 1 -- 172.21.15.53:0/825032460 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000b760 con 0x7f370c1570d0 2023-09-28T00:23:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.732+0000 7fa396ffd700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa39c067480 0x7fa39c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.733+0000 7fa3ae7fc700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa39c067480 0x7fa39c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.733+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa3a4022070 con 0x7fa3a8045430 2023-09-28T00:23:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.733+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c063a50 con 0x7fea14039e00 2023-09-28T00:23:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.733+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c063dd0 con 0x7fea14039e00 2023-09-28T00:23:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.732+0000 7f370959a700 1 -- 172.21.15.53:0/825032460 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370000b8c0 con 0x7f370c1570d0 2023-09-28T00:23:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.733+0000 7f37109ff700 1 -- 172.21.15.53:0/825032460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 msgr2=0x7f370c06e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.733+0000 7f37109ff700 1 --2- 172.21.15.53:0/825032460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 0x7f370c06e660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37000099b0 tx=0x7f3700009250 comp rx=0 tx=0).stop 2023-09-28T00:23:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.734+0000 7fa3ae7fc700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa39c067480 0x7fa39c069930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0061160 tx=0x7fa3b006b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.734+0000 7f37109ff700 1 -- 172.21.15.53:0/825032460 shutdown_connections 2023-09-28T00:23:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.734+0000 7f37109ff700 1 --2- 172.21.15.53:0/825032460 >> v2:172.21.15.118:3300/0 conn(0x7f370c15d480 0x7f370c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.734+0000 7f37109ff700 1 --2- 172.21.15.53:0/825032460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c1570d0 0x7f370c06e660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.734+0000 7f37109ff700 1 -- 172.21.15.53:0/825032460 >> 172.21.15.53:0/825032460 conn(0x7f370c0c7b20 msgr2=0x7f370c0c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.734+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a80e0f10 con 0x7fa3a8045430 2023-09-28T00:23:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.735+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140cc7d0 con 0x7fea14039e00 2023-09-28T00:23:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.736+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fea1c08d020 con 0x7fea14039e00 2023-09-28T00:23:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.737+0000 7f47f99ff700 1 Processor -- start 2023-09-28T00:23:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.738+0000 7fea127fc700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fea00067480 0x7fea00069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.738+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea1c0fc4b0 con 0x7fea14039e00 2023-09-28T00:23:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.737+0000 7f47f99ff700 1 -- start start 2023-09-28T00:23:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.735+0000 7f37109ff700 1 -- 172.21.15.53:0/825032460 shutdown_connections 2023-09-28T00:23:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.735+0000 7f37109ff700 1 -- 172.21.15.53:0/825032460 wait complete. 2023-09-28T00:23:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.738+0000 7f37109ff700 1 Processor -- start 2023-09-28T00:23:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.738+0000 7f37109ff700 1 -- start start 2023-09-28T00:23:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.739+0000 7f47f99ff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47f41535f0 0x7f47f415a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f99ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f47f406d450 0x7f47f415af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f99ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f40c2bf0 con 0x7f47f40c3080 2023-09-28T00:23:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f37109ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 0x7f370c0c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f99ff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f415a9a0 con 0x7f47f41535f0 2023-09-28T00:23:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f99ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f41540d0 con 0x7f47f406d450 2023-09-28T00:23:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f37109ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f370c1570d0 0x7f370c0c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7fea2259b700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fea00067480 0x7fea00069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f370a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 0x7f370c0c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f37fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f47f40c3080 0x7f47f41539c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54406/0 (socket says 172.21.15.53:54406) 2023-09-28T00:23:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f37fe700 1 -- 172.21.15.53:0/1589667262 learned_addr learned my addr 172.21.15.53:0/1589667262 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f47f2ffd700 1 --2- 172.21.15.53:0/1589667262 >> v2:172.21.15.53:3300/0 conn(0x7f47f41535f0 0x7f47f415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.741+0000 7f47f27fc700 1 --2- 172.21.15.53:0/1589667262 >> v2:172.21.15.118:3300/0 conn(0x7f47f406d450 0x7f47f415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.740+0000 7f370a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 0x7f370c0c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34904/0 (socket says 172.21.15.53:34904) 2023-09-28T00:23:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.741+0000 7f370a59c700 1 -- 172.21.15.53:0/1010227019 learned_addr learned my addr 172.21.15.53:0/1010227019 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.741+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c15d480 0x7f370c0872f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fea1c0c9390 con 0x7fea14039e00 2023-09-28T00:23:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f370ad9d700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c15d480 0x7f370c0872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f3709d9b700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f370c1570d0 0x7f370c0c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c17a9f0 con 0x7f370c1570d0 2023-09-28T00:23:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0c0600 con 0x7f370c06a640 2023-09-28T00:23:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c15c2d0 con 0x7f370c15d480 2023-09-28T00:23:10.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f47f2ffd700 1 -- 172.21.15.53:0/1589667262 >> v2:172.21.15.118:3300/0 conn(0x7f47f406d450 msgr2=0x7f47f415af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:10.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f47f2ffd700 1 --2- 172.21.15.53:0/1589667262 >> v2:172.21.15.118:3300/0 conn(0x7f47f406d450 0x7f47f415af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f47f2ffd700 1 -- 172.21.15.53:0/1589667262 >> v1:172.21.15.118:6789/0 conn(0x7f47f40c3080 legacy=0x7f47f41539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f47f2ffd700 1 -- 172.21.15.53:0/1589667262 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40c8170 con 0x7f47f41535f0 2023-09-28T00:23:10.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.742+0000 7f47f2ffd700 1 --2- 172.21.15.53:0/1589667262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f41535f0 0x7f47f415a460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47f4063570 tx=0x7f47dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2839711d05b5a0a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.743+0000 7f370a59c700 1 -- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c15d480 msgr2=0x7f370c0872f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.743+0000 7f370a59c700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c15d480 0x7f370c0872f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.743+0000 7f370a59c700 1 -- 172.21.15.53:0/1010227019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f370c1570d0 msgr2=0x7f370c0c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.743+0000 7fea2259b700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fea00067480 0x7fea00069930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea0c001dc0 tx=0x7fea0c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.743+0000 7f370a59c700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f370c1570d0 0x7f370c0c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.743+0000 7f370a59c700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000094f0 con 0x7f370c06a640 2023-09-28T00:23:10.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f3709d9b700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f370c1570d0 0x7f370c0c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:10.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7fc95339d700 1 Processor -- start 2023-09-28T00:23:10.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f370a59c700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 0x7f370c0c2320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3700006fd0 tx=0x7f3700016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.745+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa3a4053900 con 0x7fa3a8045430 2023-09-28T00:23:10.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700006b30 con 0x7f370c06a640 2023-09-28T00:23:10.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370001c460 con 0x7f370c06a640 2023-09-28T00:23:10.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370001c7e0 con 0x7f370c06a640 2023-09-28T00:23:10.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.745+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c15ccf0 con 0x7f370c06a640 2023-09-28T00:23:10.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.745+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c0c08a0 con 0x7f370c06a640 2023-09-28T00:23:10.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7fc95339d700 1 -- start start 2023-09-28T00:23:10.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f47f1ffb700 1 -- 172.21.15.53:0/1589667262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00b690 con 0x7f47f41535f0 2023-09-28T00:23:10.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f47f1ffb700 1 -- 172.21.15.53:0/1589667262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc00b810 con 0x7f47f41535f0 2023-09-28T00:23:10.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.744+0000 7f47f1ffb700 1 -- 172.21.15.53:0/1589667262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00bbd0 con 0x7f47f41535f0 2023-09-28T00:23:10.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.745+0000 7f47f99ff700 1 -- 172.21.15.53:0/1589667262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f41535f0 msgr2=0x7f47f415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.745+0000 7f47f99ff700 1 --2- 172.21.15.53:0/1589667262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f41535f0 0x7f47f415a460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47f4063570 tx=0x7f47dc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.746+0000 7fc95339d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc94c14b9e0 0x7fc94c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.746+0000 7fc95339d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc94c068140 0x7fc94c06ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.746+0000 7fc95339d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c06f160 0x7fc94c154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.746+0000 7fc95339d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c06de40 con 0x7fc94c14b9e0 2023-09-28T00:23:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.746+0000 7fc95339d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c06e100 con 0x7fc94c068140 2023-09-28T00:23:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.746+0000 7fc95339d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c2f60 con 0x7fc94c06f160 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.747+0000 7fc95239b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc94c14b9e0 0x7fc94c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.747+0000 7fc95239b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc94c14b9e0 0x7fc94c06e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60958/0 (socket says 172.21.15.53:60958) 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.747+0000 7fc95239b700 1 -- 172.21.15.53:0/2184062590 learned_addr learned my addr 172.21.15.53:0/2184062590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.747+0000 7fc951b9a700 1 --2- 172.21.15.53:0/2184062590 >> v2:172.21.15.118:3300/0 conn(0x7fc94c068140 0x7fc94c06ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.747+0000 7fc952b9c700 1 --2- 172.21.15.53:0/2184062590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c06f160 0x7fc94c154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7fc95239b700 1 -- 172.21.15.53:0/2184062590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c06f160 msgr2=0x7fc94c154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7fc95239b700 1 --2- 172.21.15.53:0/2184062590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c06f160 0x7fc94c154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7fc95239b700 1 -- 172.21.15.53:0/2184062590 >> v2:172.21.15.118:3300/0 conn(0x7fc94c068140 msgr2=0x7fc94c06ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7fc95239b700 1 --2- 172.21.15.53:0/2184062590 >> v2:172.21.15.118:3300/0 conn(0x7fc94c068140 0x7fc94c06ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7fc95239b700 1 -- 172.21.15.53:0/2184062590 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0c3240 con 0x7fc94c14b9e0 2023-09-28T00:23:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7fc95239b700 1 --2- 172.21.15.53:0/2184062590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c14b9e0 0x7fc94c06e680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0c51e0 tx=0x7fc944009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a20584b9a88c66c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00052b0 con 0x7f370c06a640 2023-09-28T00:23:10.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.749+0000 7fc951399700 1 -- 172.21.15.53:0/2184062590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400e070 con 0x7fc94c14b9e0 2023-09-28T00:23:10.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7f47f99ff700 1 -- 172.21.15.53:0/1589667262 shutdown_connections 2023-09-28T00:23:10.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7f47f99ff700 1 --2- 172.21.15.53:0/1589667262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f41535f0 0x7f47f415a460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7f47f99ff700 1 --2- 172.21.15.53:0/1589667262 >> v2:172.21.15.118:3300/0 conn(0x7f47f406d450 0x7f47f415af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.748+0000 7f47f99ff700 1 -- 172.21.15.53:0/1589667262 >> 172.21.15.53:0/1589667262 conn(0x7f47f4068100 msgr2=0x7f47f40c7950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.749+0000 7fc951399700 1 -- 172.21.15.53:0/2184062590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400bae0 con 0x7fc94c14b9e0 2023-09-28T00:23:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.749+0000 7fc951399700 1 -- 172.21.15.53:0/2184062590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440092e0 con 0x7fc94c14b9e0 2023-09-28T00:23:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 -- 172.21.15.53:0/2184062590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c14b9e0 msgr2=0x7fc94c06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.749+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f370001cc10 con 0x7f370c06a640 2023-09-28T00:23:10.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.750+0000 7f36fa7fc700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f36ec067480 0x7f36ec069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7f47f99ff700 1 -- 172.21.15.53:0/1589667262 shutdown_connections 2023-09-28T00:23:10.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.750+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3700087030 con 0x7f370c06a640 2023-09-28T00:23:10.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 --2- 172.21.15.53:0/2184062590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c14b9e0 0x7fc94c06e680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0c51e0 tx=0x7fc944009840 comp rx=0 tx=0).stop 2023-09-28T00:23:10.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 -- 172.21.15.53:0/2184062590 shutdown_connections 2023-09-28T00:23:10.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7f3709d9b700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f36ec067480 0x7f36ec069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 --2- 172.21.15.53:0/2184062590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c06f160 0x7fc94c154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 --2- 172.21.15.53:0/2184062590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c14b9e0 0x7fc94c06e680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 --2- 172.21.15.53:0/2184062590 >> v2:172.21.15.118:3300/0 conn(0x7fc94c068140 0x7fc94c06ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7f47f99ff700 1 -- 172.21.15.53:0/1589667262 wait complete. 2023-09-28T00:23:10.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.751+0000 7fc95339d700 1 -- 172.21.15.53:0/2184062590 >> 172.21.15.53:0/2184062590 conn(0x7fc94c067630 msgr2=0x7fc94c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:10.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.752+0000 7fc95339d700 1 -- 172.21.15.53:0/2184062590 shutdown_connections 2023-09-28T00:23:10.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.752+0000 7f3709d9b700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f36ec067480 0x7f36ec069930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f370c0c6d80 tx=0x7f36fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.752+0000 7fc95339d700 1 -- 172.21.15.53:0/2184062590 wait complete. 2023-09-28T00:23:10.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.754+0000 7f47f99ff700 1 Processor -- start 2023-09-28T00:23:10.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.754+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f37000b8570 con 0x7f370c06a640 2023-09-28T00:23:10.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.755+0000 7f47f99ff700 1 -- start start 2023-09-28T00:23:10.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.755+0000 7fc95339d700 1 Processor -- start 2023-09-28T00:23:10.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.756+0000 7f47f99ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f406d450 0x7f47f416e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f99ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47f40c3080 0x7f47f40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f99ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47f41535f0 0x7f47f40c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f406d450 0x7f47f416e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f406d450 0x7f47f416e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60960/0 (socket says 172.21.15.53:60960) 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f99ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f416e580 con 0x7f47f406d450 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f2ffd700 1 -- 172.21.15.53:0/2427414766 learned_addr learned my addr 172.21.15.53:0/2427414766 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f416a140 con 0x7f47f40c3080 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c7850 con 0x7f47f41535f0 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.757+0000 7f47f27fc700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47f40c3080 0x7f47f40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.758+0000 7f47f37fe700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47f41535f0 0x7f47f40c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.758+0000 7f47f37fe700 1 -- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47f40c3080 msgr2=0x7f47f40c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.758+0000 7f47f37fe700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47f40c3080 0x7f47f40c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.758+0000 7f47f37fe700 1 -- 172.21.15.53:0/2427414766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f406d450 msgr2=0x7f47f416e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.758+0000 7f47f37fe700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f406d450 0x7f47f416e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.758+0000 7f47f37fe700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc009420 con 0x7f47f41535f0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.759+0000 7f47f37fe700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47f41535f0 0x7f47f40c6c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c3470 tx=0x7f47ec001960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.759+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00a880 con 0x7f47f41535f0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00aa00 con 0x7f47f41535f0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f416a400 con 0x7f47f41535f0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f416a9c0 con 0x7f47f41535f0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00adc0 con 0x7f47f41535f0 2023-09-28T00:23:10.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d80052b0 con 0x7f47f41535f0 2023-09-28T00:23:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.756+0000 7fc95339d700 1 -- start start 2023-09-28T00:23:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.759+0000 7fc95339d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 0x7fc94c1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.759+0000 7fc95339d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c06f160 0x7fc94c144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.759+0000 7fc95339d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c14b9e0 0x7fc94c16d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.759+0000 7fc95339d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c16da80 con 0x7fc94c06f160 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7fc95339d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c143b40 con 0x7fc94c068140 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7fc95239b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 0x7fc94c1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7fc95339d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c143e20 con 0x7fc94c14b9e0 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7fc95239b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 0x7fc94c1483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:34952/0 (socket says 172.21.15.53:34952) 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7fc95239b700 1 -- 172.21.15.53:0/3076472724 learned_addr learned my addr 172.21.15.53:0/3076472724 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.760+0000 7fc951b9a700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c06f160 0x7fc94c144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7fc95239b700 1 -- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c14b9e0 msgr2=0x7fc94c16d010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7fc95239b700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c14b9e0 0x7fc94c16d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7fc95239b700 1 -- 172.21.15.53:0/3076472724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c06f160 msgr2=0x7fc94c144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7fc95239b700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c06f160 0x7fc94c144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7fc95239b700 1 -- 172.21.15.53:0/3076472724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009ae0 con 0x7fc94c068140 2023-09-28T00:23:10.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.762+0000 7fc951b9a700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c06f160 0x7fc94c144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:10.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.765+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f47ec007300 con 0x7f47f41535f0 2023-09-28T00:23:10.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.765+0000 7fc95239b700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 0x7fc94c1483d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc94c06d5c0 tx=0x7fc944018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.766+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944008ae0 con 0x7fc94c068140 2023-09-28T00:23:10.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.766+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944008c60 con 0x7fc94c068140 2023-09-28T00:23:10.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.766+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94401c410 con 0x7fc94c068140 2023-09-28T00:23:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.766+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c144100 con 0x7fc94c068140 2023-09-28T00:23:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.766+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c144e40 con 0x7fc94c068140 2023-09-28T00:23:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.766+0000 7f47eaffd700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47d4067380 0x7f47d4069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.767+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47ec085140 con 0x7f47f41535f0 2023-09-28T00:23:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.768+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f47ec0520a0 con 0x7f47f41535f0 2023-09-28T00:23:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.769+0000 7f47f2ffd700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47d4067380 0x7f47d4069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.770+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc944003040 con 0x7fc94c068140 2023-09-28T00:23:10.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.772+0000 7fc9427fc700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc930067480 0x7fc930069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:10.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.772+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc944086230 con 0x7fc94c068140 2023-09-28T00:23:10.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.773+0000 7fc951b9a700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc930067480 0x7fc930069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:10.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.773+0000 7fc951b9a700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc930067480 0x7fc930069930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc94c14b370 tx=0x7fc93c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.774+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9340052b0 con 0x7fc94c068140 2023-09-28T00:23:10.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.774+0000 7f47f2ffd700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47d4067380 0x7f47d4069830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0093c0 tx=0x7f47dc017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:10.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:10.780+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc944053110 con 0x7fc94c068140 2023-09-28T00:23:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.106+0000 7fbc04ff9700 1 -- 172.21.15.53:0/1061015576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbbf8005560 con 0x7fbc10039f10 2023-09-28T00:23:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.107+0000 7fbc06ffd700 1 -- 172.21.15.53:0/1061015576 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc08056750 con 0x7fbc10039f10 2023-09-28T00:23:11.107 INFO:teuthology.orchestra.run.smithi053.stdout:60129542151 2023-09-28T00:23:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.111+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbbfc0673d0 msgr2=0x7fbbfc069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.111+0000 7fbc17fff700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbbfc0673d0 0x7fbbfc069880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006fd0 tx=0x7fbc0c008040 comp rx=0 tx=0).stop 2023-09-28T00:23:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.111+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 msgr2=0x7fbc1004a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.111+0000 7fbc17fff700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 0x7fbc1004a720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbc08016000 tx=0x7fbc08017000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.112+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 shutdown_connections 2023-09-28T00:23:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.112+0000 7fbc17fff700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fbbfc0673d0 0x7fbbfc069880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.112+0000 7fbc17fff700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1004f110 0x7fbc100d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.112+0000 7fbc17fff700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc10010fd0 0x7fbc10048a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.112+0000 7fbc17fff700 1 --2- 172.21.15.53:0/1061015576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc10039f10 0x7fbc1004a720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.113+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 >> 172.21.15.53:0/1061015576 conn(0x7fbc10051cb0 msgr2=0x7fbc100d7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.113+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 shutdown_connections 2023-09-28T00:23:11.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.113+0000 7fbc17fff700 1 -- 172.21.15.53:0/1061015576 wait complete. 2023-09-28T00:23:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.121+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f04d4005560 con 0x7f04f0045a30 2023-09-28T00:23:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.122+0000 7f04edffb700 1 -- 172.21.15.53:0/1321516607 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04f80ccb20 con 0x7f04f0045a30 2023-09-28T00:23:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:64424509448 2023-09-28T00:23:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.126+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f04dc067480 msgr2=0x7f04dc069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.126+0000 7f04db7fe700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f04dc067480 0x7f04dc069930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009bd0 tx=0x7f04f40090f0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.127+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f0045a30 msgr2=0x7f04f0050370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.127+0000 7f04db7fe700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f0045a30 0x7f04f0050370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04f80670a0 tx=0x7f04f806c000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.127+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 shutdown_connections 2023-09-28T00:23:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.127+0000 7f04db7fe700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f04dc067480 0x7f04dc069930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.127+0000 7f04db7fe700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f00076b0 0x7f04f00474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.128+0000 7f04db7fe700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f0050dc0 0x7f04f004c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.128+0000 7f04db7fe700 1 --2- 172.21.15.53:0/1321516607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f0045a30 0x7f04f0050370 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.128+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 >> 172.21.15.53:0/1321516607 conn(0x7f04f000bfc0 msgr2=0x7f04f00d9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.128+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 shutdown_connections 2023-09-28T00:23:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.128+0000 7f04db7fe700 1 -- 172.21.15.53:0/1321516607 wait complete. 2023-09-28T00:23:11.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.134+0000 7efec8ff9700 1 -- 172.21.15.53:0/801019768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efec4005560 con 0x7efedc045320 2023-09-28T00:23:11.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.134+0000 7efecaffd700 1 -- 172.21.15.53:0/801019768 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efee40d0090 con 0x7efedc045320 2023-09-28T00:23:11.134 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-09-28T00:23:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.138+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efed0067480 msgr2=0x7efed0069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.138+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efed0067480 0x7efed0069930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efed80099b0 tx=0x7efed8016000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 msgr2=0x7efedc0c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 0x7efedc0c5390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efee404d1b0 tx=0x7efee4066740 comp rx=0 tx=0).stop 2023-09-28T00:23:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 shutdown_connections 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efed0067480 0x7efed0069930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efedc045320 0x7efedc0c5390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efedc0dbf50 0x7efedc0caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 --2- 172.21.15.53:0/801019768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efedc0456f0 0x7efedc0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 >> 172.21.15.53:0/801019768 conn(0x7efedc00beb0 msgr2=0x7efedc0e0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.139+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 shutdown_connections 2023-09-28T00:23:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.140+0000 7efee99ff700 1 -- 172.21.15.53:0/801019768 wait complete. 2023-09-28T00:23:11.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-09-28T00:23:11.143 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2023-09-28T00:23:11.161 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2023-09-28T00:23:11.169 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.173+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa3a80054e0 con 0x7fa3a8045430 2023-09-28T00:23:11.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.173+0000 7fa396ffd700 1 -- 172.21.15.53:0/4139206449 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3a4056f20 con 0x7fa3a8045430 2023-09-28T00:23:11.173 INFO:teuthology.orchestra.run.smithi053.stdout:60129542152 2023-09-28T00:23:11.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa39c067480 msgr2=0x7fa39c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa39c067480 0x7fa39c069930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0061160 tx=0x7fa3b006b040 comp rx=0 tx=0).stop 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a8045430 msgr2=0x7fa3a80c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a8045430 0x7fa3a80c5cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800ddd0 tx=0x7fa3a4016000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 shutdown_connections 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa39c067480 0x7fa39c069930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3a80dc060 0x7fa3a80d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3a8045430 0x7fa3a80c5cf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 --2- 172.21.15.53:0/4139206449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3a8045800 0x7fa3a80d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 >> 172.21.15.53:0/4139206449 conn(0x7fa3a800bfc0 msgr2=0x7fa3a80e0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 shutdown_connections 2023-09-28T00:23:11.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.176+0000 7fa3affff700 1 -- 172.21.15.53:0/4139206449 wait complete. 2023-09-28T00:23:11.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.7 2023-09-28T00:23:11.194 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.200+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea14005390 con 0x7fea14039e00 2023-09-28T00:23:11.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.200+0000 7fea127fc700 1 -- 172.21.15.53:0/3632921257 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea1c0cc9b0 con 0x7fea14039e00 2023-09-28T00:23:11.200 INFO:teuthology.orchestra.run.smithi053.stdout:60129542153 2023-09-28T00:23:11.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.202+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36f0005560 con 0x7f370c06a640 2023-09-28T00:23:11.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.203+0000 7f36fa7fc700 1 -- 172.21.15.53:0/1010227019 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3700053f10 con 0x7f370c06a640 2023-09-28T00:23:11.203 INFO:teuthology.orchestra.run.smithi053.stdout:64424509449 2023-09-28T00:23:11.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fea00067480 msgr2=0x7fea00069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fea00067480 0x7fea00069930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea0c001dc0 tx=0x7fea0c009040 comp rx=0 tx=0).stop 2023-09-28T00:23:11.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea14039e00 msgr2=0x7fea14052a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea14039e00 0x7fea14052a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea1c04d1b0 tx=0x7fea1c08c000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 shutdown_connections 2023-09-28T00:23:11.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fea00067480 0x7fea00069930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea14050270 0x7fea14052f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea14037ed0 0x7fea14049050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 --2- 172.21.15.53:0/3632921257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea14039e00 0x7fea14052a50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 >> 172.21.15.53:0/3632921257 conn(0x7fea14051ba0 msgr2=0x7fea14053e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 shutdown_connections 2023-09-28T00:23:11.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.204+0000 7fea07fff700 1 -- 172.21.15.53:0/3632921257 wait complete. 2023-09-28T00:23:11.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.205+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f36ec067480 msgr2=0x7f36ec069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.205+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f36ec067480 0x7f36ec069930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f370c0c6d80 tx=0x7f36fc009040 comp rx=0 tx=0).stop 2023-09-28T00:23:11.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.205+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 msgr2=0x7f370c0c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.205+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 0x7f370c0c2320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3700006fd0 tx=0x7f3700016000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.205+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 shutdown_connections 2023-09-28T00:23:11.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.205+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f36ec067480 0x7f36ec069930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.206+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f370c15d480 0x7f370c0872f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.206+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f370c06a640 0x7f370c0c2320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.206+0000 7f37109ff700 1 --2- 172.21.15.53:0/1010227019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f370c1570d0 0x7f370c0c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.206+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 >> 172.21.15.53:0/1010227019 conn(0x7f370c0c7b20 msgr2=0x7f370c0c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.206+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 shutdown_connections 2023-09-28T00:23:11.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.206+0000 7f37109ff700 1 -- 172.21.15.53:0/1010227019 wait complete. 2023-09-28T00:23:11.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.213+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47d8005830 con 0x7f47f41535f0 2023-09-28T00:23:11.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.214+0000 7f47eaffd700 1 -- 172.21.15.53:0/2427414766 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47ec0556c0 con 0x7f47f41535f0 2023-09-28T00:23:11.214 INFO:teuthology.orchestra.run.smithi053.stdout:60129542153 2023-09-28T00:23:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47d4067380 msgr2=0x7f47d4069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47d4067380 0x7f47d4069830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0093c0 tx=0x7f47dc017000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47f41535f0 msgr2=0x7f47f40c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47f41535f0 0x7f47f40c6c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c3470 tx=0x7f47ec001960 comp rx=0 tx=0).stop 2023-09-28T00:23:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 shutdown_connections 2023-09-28T00:23:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47d4067380 0x7f47d4069830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47f41535f0 0x7f47f40c6c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f406d450 0x7f47f416e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 --2- 172.21.15.53:0/2427414766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47f40c3080 0x7f47f40c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.216+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 >> 172.21.15.53:0/2427414766 conn(0x7f47f4068100 msgr2=0x7f47f415bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.217+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 shutdown_connections 2023-09-28T00:23:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.217+0000 7f47f99ff700 1 -- 172.21.15.53:0/2427414766 wait complete. 2023-09-28T00:23:11.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.0 2023-09-28T00:23:11.225 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.228+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc934005560 con 0x7fc94c068140 2023-09-28T00:23:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.229+0000 7fc9427fc700 1 -- 172.21.15.53:0/3076472724 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc944009940 con 0x7fc94c068140 2023-09-28T00:23:11.229 INFO:teuthology.orchestra.run.smithi053.stdout:60129542153 2023-09-28T00:23:11.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc930067480 msgr2=0x7fc930069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc930067480 0x7fc930069930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc94c14b370 tx=0x7fc93c008040 comp rx=0 tx=0).stop 2023-09-28T00:23:11.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 msgr2=0x7fc94c1483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 0x7fc94c1483d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc94c06d5c0 tx=0x7fc944018000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 shutdown_connections 2023-09-28T00:23:11.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc930067480 0x7fc930069930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c14b9e0 0x7fc94c16d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c068140 0x7fc94c1483d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 --2- 172.21.15.53:0/3076472724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c06f160 0x7fc94c144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 >> 172.21.15.53:0/3076472724 conn(0x7fc94c067630 msgr2=0x7fc94c067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 shutdown_connections 2023-09-28T00:23:11.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.232+0000 7fc95339d700 1 -- 172.21.15.53:0/3076472724 wait complete. 2023-09-28T00:23:11.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.2 2023-09-28T00:23:11.238 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.3 2023-09-28T00:23:11.239 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.5 2023-09-28T00:23:11.250 DEBUG:teuthology.parallel:result is None 2023-09-28T00:23:11.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T00:23:11.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.476+0000 7fda0e59d700 1 Processor -- start 2023-09-28T00:23:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.476+0000 7fda0e59d700 1 -- start start 2023-09-28T00:23:11.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.477+0000 7fda0e59d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda08068990 0x7fda08068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.477+0000 7fda0e59d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda081557c0 con 0x7fda080c71f0 2023-09-28T00:23:11.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.477+0000 7fda0e59d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0806c7d0 con 0x7fda0806cc60 2023-09-28T00:23:11.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.477+0000 7fda0e59d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda080692a0 con 0x7fda08068990 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0d59b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda08068990 0x7fda08068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0dd9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda080c71f0 0x7fda080c2fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58644/0 (socket says 172.21.15.53:58644) 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0dd9c700 1 -- 172.21.15.53:0/2300684829 learned_addr learned my addr 172.21.15.53:0/2300684829 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0d59b700 1 -- 172.21.15.53:0/2300684829 >> v1:172.21.15.118:6789/0 conn(0x7fda0806cc60 legacy=0x7fda081568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0d59b700 1 -- 172.21.15.53:0/2300684829 >> v1:172.21.15.53:6789/0 conn(0x7fda080c71f0 legacy=0x7fda080c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0d59b700 1 -- 172.21.15.53:0/2300684829 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080635f0 con 0x7fda08068990 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fd9fffff700 1 -- 172.21.15.53:0/2300684829 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377794961 0 0) 0x7fda081557c0 con 0x7fda080c71f0 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.478+0000 7fda0d59b700 1 --2- 172.21.15.53:0/2300684829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda08068990 0x7fda08068d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda04009910 tx=0x7fda040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4165647a49bac2f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fd9fffff700 1 -- 172.21.15.53:0/2300684829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400b820 con 0x7fda08068990 2023-09-28T00:23:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fd9fffff700 1 -- 172.21.15.53:0/2300684829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b980 con 0x7fda08068990 2023-09-28T00:23:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fd9fffff700 1 -- 172.21.15.53:0/2300684829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400bd20 con 0x7fda08068990 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 -- 172.21.15.53:0/2300684829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda08068990 msgr2=0x7fda08068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 --2- 172.21.15.53:0/2300684829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda08068990 0x7fda08068d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda04009910 tx=0x7fda040091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 -- 172.21.15.53:0/2300684829 shutdown_connections 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 --2- 172.21.15.53:0/2300684829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda08068990 0x7fda08068d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 -- 172.21.15.53:0/2300684829 >> 172.21.15.53:0/2300684829 conn(0x7fda08067630 msgr2=0x7fda08067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 -- 172.21.15.53:0/2300684829 shutdown_connections 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.479+0000 7fda0e59d700 1 -- 172.21.15.53:0/2300684829 wait complete. 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.481+0000 7fda0e59d700 1 Processor -- start 2023-09-28T00:23:11.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.481+0000 7fda0e59d700 1 -- start start 2023-09-28T00:23:11.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0e59d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda08068990 0x7fda08165b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0e59d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda0806cc60 0x7fda08147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0e59d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 0x7fda0815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0e59d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda08165180 con 0x7fda080c71f0 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0e59d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda08169600 con 0x7fda0806cc60 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0e59d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda081660d0 con 0x7fda08068990 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 0x7fda0815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 0x7fda0815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60978/0 (socket says 172.21.15.53:60978) 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0d59b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda08068990 0x7fda08165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 -- 172.21.15.53:0/373901345 learned_addr learned my addr 172.21.15.53:0/373901345 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0cd9a700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda0806cc60 0x7fda08147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 -- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda08068990 msgr2=0x7fda08165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda08068990 0x7fda08165b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 -- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda0806cc60 msgr2=0x7fda08147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda0806cc60 0x7fda08147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.482+0000 7fda0dd9c700 1 -- 172.21.15.53:0/373901345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009420 con 0x7fda080c71f0 2023-09-28T00:23:11.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.483+0000 7fda0dd9c700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 0x7fda0815afe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda0000cc20 tx=0x7fda000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:11.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.483+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000a8a0 con 0x7fda080c71f0 2023-09-28T00:23:11.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.483+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0000aa00 con 0x7fda080c71f0 2023-09-28T00:23:11.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.483+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000adc0 con 0x7fda080c71f0 2023-09-28T00:23:11.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.483+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda08165700 con 0x7fda080c71f0 2023-09-28T00:23:11.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.483+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0814a790 con 0x7fda080c71f0 2023-09-28T00:23:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.484+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda08165890 con 0x7fda080c71f0 2023-09-28T00:23:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.485+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fda00007300 con 0x7fda080c71f0 2023-09-28T00:23:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.486+0000 7fd9fd7fa700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd9ec067330 0x7fd9ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.486+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fda00084ee0 con 0x7fda080c71f0 2023-09-28T00:23:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.486+0000 7fda0d59b700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd9ec067330 0x7fd9ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.487+0000 7fda0d59b700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd9ec067330 0x7fd9ec0697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda040093f0 tx=0x7fda04017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.490+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fda00051dc0 con 0x7fda080c71f0 2023-09-28T00:23:11.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.687+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda0804c3c0 con 0x7fd9ec067330 2023-09-28T00:23:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.697+0000 7fd9fd7fa700 1 -- 172.21.15.53:0/373901345 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284717 (secure 0 0 0) 0x7fda0804c3c0 con 0x7fd9ec067330 2023-09-28T00:23:11.700 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.700+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd9ec067330 msgr2=0x7fd9ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.700+0000 7fda0e59d700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd9ec067330 0x7fd9ec0697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda040093f0 tx=0x7fda04017000 comp rx=0 tx=0).stop 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.700+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 msgr2=0x7fda0815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.700+0000 7fda0e59d700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 0x7fda0815afe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda0000cc20 tx=0x7fda000019b0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 shutdown_connections 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd9ec067330 0x7fd9ec0697e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda08068990 0x7fda08165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda080c71f0 0x7fda0815afe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 --2- 172.21.15.53:0/373901345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda0806cc60 0x7fda08147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 >> 172.21.15.53:0/373901345 conn(0x7fda08067630 msgr2=0x7fda080c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 shutdown_connections 2023-09-28T00:23:11.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.701+0000 7fda0e59d700 1 -- 172.21.15.53:0/373901345 wait complete. 2023-09-28T00:23:11.704 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:11.718 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-09-28T00:23:11.104538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83496,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80000,"kb_avail":754891224,"statfs":{"total":773094113280,"available":773008613376,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81920000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7626,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.414943"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711001+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.711001+0000","last_peered":"2023-09-28T00:22:59.711001+0000","last_clean":"2023-09-28T00:22:59.711001+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.711001+0000","last_undegraded":"2023-09-28T00:22:59.711001+0000","last_fullsized":"2023-09-28T00:22:59.711001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706544+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.706544+0000","last_peered":"2023-09-28T00:22:59.706544+0000","last_clean":"2023-09-28T00:22:59.706544+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.706544+0000","last_undegraded":"2023-09-28T00:22:59.706544+0000","last_fullsized":"2023-09-28T00:22:59.706544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.699416+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.699416+0000","last_peered":"2023-09-28T00:22:59.699416+0000","last_clean":"2023-09-28T00:22:59.699416+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.699416+0000","last_undegraded":"2023-09-28T00:22:59.699416+0000","last_fullsized":"2023-09-28T00:22:59.699416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706323+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.706323+0000","last_peered":"2023-09-28T00:22:59.706323+0000","last_clean":"2023-09-28T00:22:59.706323+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.706323+0000","last_undegraded":"2023-09-28T00:22:59.706323+0000","last_fullsized":"2023-09-28T00:22:59.706323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717199+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.717199+0000","last_peered":"2023-09-28T00:22:59.717199+0000","last_clean":"2023-09-28T00:22:59.717199+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.717199+0000","last_undegraded":"2023-09-28T00:22:59.717199+0000","last_fullsized":"2023-09-28T00:22:59.717199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706336+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.706336+0000","last_peered":"2023-09-28T00:22:59.706336+0000","last_clean":"2023-09-28T00:22:59.706336+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.706336+0000","last_undegraded":"2023-09-28T00:22:59.706336+0000","last_fullsized":"2023-09-28T00:22:59.706336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717656+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.717656+0000","last_peered":"2023-09-28T00:22:59.717656+0000","last_clean":"2023-09-28T00:22:59.717656+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.717656+0000","last_undegraded":"2023-09-28T00:22:59.717656+0000","last_fullsized":"2023-09-28T00:22:59.717656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713628+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.713628+0000","last_peered":"2023-09-28T00:22:59.713628+0000","last_clean":"2023-09-28T00:22:59.713628+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.713628+0000","last_undegraded":"2023-09-28T00:22:59.713628+0000","last_fullsized":"2023-09-28T00:22:59.713628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721596+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:23:04.721596+0000","last_peered":"2023-09-28T00:23:04.721596+0000","last_clean":"2023-09-28T00:23:04.721596+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:04.721596+0000","last_undegraded":"2023-09-28T00:23:04.721596+0000","last_fullsized":"2023-09-28T00:23:04.721596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721198+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721198+0000","last_peered":"2023-09-28T00:23:03.721198+0000","last_clean":"2023-09-28T00:23:03.721198+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721198+0000","last_undegraded":"2023-09-28T00:23:03.721198+0000","last_fullsized":"2023-09-28T00:23:03.721198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.717925+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:04.717925+0000","last_peered":"2023-09-28T00:23:04.717925+0000","last_clean":"2023-09-28T00:23:04.717925+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:04.717925+0000","last_undegraded":"2023-09-28T00:23:04.717925+0000","last_fullsized":"2023-09-28T00:23:04.717925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.710025+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.710025+0000","last_peered":"2023-09-28T00:23:02.710025+0000","last_clean":"2023-09-28T00:23:02.710025+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.710025+0000","last_undegraded":"2023-09-28T00:23:02.710025+0000","last_fullsized":"2023-09-28T00:23:02.710025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728314+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:23:05.728314+0000","last_peered":"2023-09-28T00:23:05.728314+0000","last_clean":"2023-09-28T00:23:05.728314+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:05.728314+0000","last_undegraded":"2023-09-28T00:23:05.728314+0000","last_fullsized":"2023-09-28T00:23:05.728314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728766+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728766+0000","last_peered":"2023-09-28T00:23:05.728766+0000","last_clean":"2023-09-28T00:23:05.728766+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728766+0000","last_undegraded":"2023-09-28T00:23:05.728766+0000","last_fullsized":"2023-09-28T00:23:05.728766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723035+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.723035+0000","last_peered":"2023-09-28T00:22:59.723035+0000","last_clean":"2023-09-28T00:22:59.723035+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.723035+0000","last_undegraded":"2023-09-28T00:22:59.723035+0000","last_fullsized":"2023-09-28T00:22:59.723035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726359+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726359+0000","last_peered":"2023-09-28T00:23:05.726359+0000","last_clean":"2023-09-28T00:23:05.726359+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726359+0000","last_undegraded":"2023-09-28T00:23:05.726359+0000","last_fullsized":"2023-09-28T00:23:05.726359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720017+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:04.720017+0000","last_peered":"2023-09-28T00:23:04.720017+0000","last_clean":"2023-09-28T00:23:04.720017+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:04.720017+0000","last_undegraded":"2023-09-28T00:23:04.720017+0000","last_fullsized":"2023-09-28T00:23:04.720017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722483+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:04.722483+0000","last_peered":"2023-09-28T00:23:04.722483+0000","last_clean":"2023-09-28T00:23:04.722483+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:04.722483+0000","last_undegraded":"2023-09-28T00:23:04.722483+0000","last_fullsized":"2023-09-28T00:23:04.722483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'17","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722261+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:23:04.722261+0000","last_peered":"2023-09-28T00:23:04.722261+0000","last_clean":"2023-09-28T00:23:04.722261+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:04.722261+0000","last_undegraded":"2023-09-28T00:23:04.722261+0000","last_fullsized":"2023-09-28T00:23:04.722261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188982+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:23:02.188982+0000","last_peered":"2023-09-28T00:23:02.188982+0000","last_clean":"2023-09-28T00:23:02.188982+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:02.188982+0000","last_undegraded":"2023-09-28T00:23:02.188982+0000","last_fullsized":"2023-09-28T00:23:02.188982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728186+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:23:05.728186+0000","last_peered":"2023-09-28T00:23:05.728186+0000","last_clean":"2023-09-28T00:23:05.728186+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:05.728186+0000","last_undegraded":"2023-09-28T00:23:05.728186+0000","last_fullsized":"2023-09-28T00:23:05.728186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715645+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.715645+0000","last_peered":"2023-09-28T00:22:59.715645+0000","last_clean":"2023-09-28T00:22:59.715645+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.715645+0000","last_undegraded":"2023-09-28T00:22:59.715645+0000","last_fullsized":"2023-09-28T00:22:59.715645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721507+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:23:04.721507+0000","last_peered":"2023-09-28T00:23:04.721507+0000","last_clean":"2023-09-28T00:23:04.721507+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:04.721507+0000","last_undegraded":"2023-09-28T00:23:04.721507+0000","last_fullsized":"2023-09-28T00:23:04.721507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723111+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.723111+0000","last_peered":"2023-09-28T00:22:59.723111+0000","last_clean":"2023-09-28T00:22:59.723111+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.723111+0000","last_undegraded":"2023-09-28T00:22:59.723111+0000","last_fullsized":"2023-09-28T00:22:59.723111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718572+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:04.718572+0000","last_peered":"2023-09-28T00:23:04.718572+0000","last_clean":"2023-09-28T00:23:04.718572+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:04.718572+0000","last_undegraded":"2023-09-28T00:23:04.718572+0000","last_fullsized":"2023-09-28T00:23:04.718572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722580+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:04.722580+0000","last_peered":"2023-09-28T00:23:04.722580+0000","last_clean":"2023-09-28T00:23:04.722580+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:04.722580+0000","last_undegraded":"2023-09-28T00:23:04.722580+0000","last_fullsized":"2023-09-28T00:23:04.722580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725840+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725840+0000","last_peered":"2023-09-28T00:23:05.725840+0000","last_clean":"2023-09-28T00:23:05.725840+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725840+0000","last_undegraded":"2023-09-28T00:23:05.725840+0000","last_fullsized":"2023-09-28T00:23:05.725840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723139+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.723139+0000","last_peered":"2023-09-28T00:22:59.723139+0000","last_clean":"2023-09-28T00:22:59.723139+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.723139+0000","last_undegraded":"2023-09-28T00:22:59.723139+0000","last_fullsized":"2023-09-28T00:22:59.723139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720076+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:23:04.720076+0000","last_peered":"2023-09-28T00:23:04.720076+0000","last_clean":"2023-09-28T00:23:04.720076+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:04.720076+0000","last_undegraded":"2023-09-28T00:23:04.720076+0000","last_fullsized":"2023-09-28T00:23:04.720076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720391+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:04.720391+0000","last_peered":"2023-09-28T00:23:04.720391+0000","last_clean":"2023-09-28T00:23:04.720391+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:04.720391+0000","last_undegraded":"2023-09-28T00:23:04.720391+0000","last_fullsized":"2023-09-28T00:23:04.720391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719030+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.719030+0000","last_peered":"2023-09-28T00:23:03.719030+0000","last_clean":"2023-09-28T00:23:03.719030+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.719030+0000","last_undegraded":"2023-09-28T00:23:03.719030+0000","last_fullsized":"2023-09-28T00:23:03.719030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691167+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.691167+0000","last_peered":"2023-09-28T00:22:59.691167+0000","last_clean":"2023-09-28T00:22:59.691167+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.691167+0000","last_undegraded":"2023-09-28T00:22:59.691167+0000","last_fullsized":"2023-09-28T00:22:59.691167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728787+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:05.728787+0000","last_peered":"2023-09-28T00:23:05.728787+0000","last_clean":"2023-09-28T00:23:05.728787+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:05.728787+0000","last_undegraded":"2023-09-28T00:23:05.728787+0000","last_fullsized":"2023-09-28T00:23:05.728787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719836+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.719836+0000","last_peered":"2023-09-28T00:23:03.719836+0000","last_clean":"2023-09-28T00:23:03.719836+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.719836+0000","last_undegraded":"2023-09-28T00:23:03.719836+0000","last_fullsized":"2023-09-28T00:23:03.719836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189439+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:23:02.189439+0000","last_peered":"2023-09-28T00:23:02.189439+0000","last_clean":"2023-09-28T00:23:02.189439+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:02.189439+0000","last_undegraded":"2023-09-28T00:23:02.189439+0000","last_fullsized":"2023-09-28T00:23:02.189439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722475+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:05.722475+0000","last_peered":"2023-09-28T00:23:05.722475+0000","last_clean":"2023-09-28T00:23:05.722475+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:05.722475+0000","last_undegraded":"2023-09-28T00:23:05.722475+0000","last_fullsized":"2023-09-28T00:23:05.722475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718240+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:04.718240+0000","last_peered":"2023-09-28T00:23:04.718240+0000","last_clean":"2023-09-28T00:23:04.718240+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:04.718240+0000","last_undegraded":"2023-09-28T00:23:04.718240+0000","last_fullsized":"2023-09-28T00:23:04.718240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722920+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.722920+0000","last_peered":"2023-09-28T00:22:59.722920+0000","last_clean":"2023-09-28T00:22:59.722920+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.722920+0000","last_undegraded":"2023-09-28T00:22:59.722920+0000","last_fullsized":"2023-09-28T00:22:59.722920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725530+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:23:05.725530+0000","last_peered":"2023-09-28T00:23:05.725530+0000","last_clean":"2023-09-28T00:23:05.725530+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:05.725530+0000","last_undegraded":"2023-09-28T00:23:05.725530+0000","last_fullsized":"2023-09-28T00:23:05.725530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710487+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.710487+0000","last_peered":"2023-09-28T00:22:59.710487+0000","last_clean":"2023-09-28T00:22:59.710487+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.710487+0000","last_undegraded":"2023-09-28T00:22:59.710487+0000","last_fullsized":"2023-09-28T00:22:59.710487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'12","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.727227+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:05.727227+0000","last_peered":"2023-09-28T00:23:05.727227+0000","last_clean":"2023-09-28T00:23:05.727227+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:05.727227+0000","last_undegraded":"2023-09-28T00:23:05.727227+0000","last_fullsized":"2023-09-28T00:23:05.727227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712741+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.712741+0000","last_peered":"2023-09-28T00:22:59.712741+0000","last_clean":"2023-09-28T00:22:59.712741+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.712741+0000","last_undegraded":"2023-09-28T00:22:59.712741+0000","last_fullsized":"2023-09-28T00:22:59.712741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'13","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725695+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:05.725695+0000","last_peered":"2023-09-28T00:23:05.725695+0000","last_clean":"2023-09-28T00:23:05.725695+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:05.725695+0000","last_undegraded":"2023-09-28T00:23:05.725695+0000","last_fullsized":"2023-09-28T00:23:05.725695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710691+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.710691+0000","last_peered":"2023-09-28T00:22:59.710691+0000","last_clean":"2023-09-28T00:22:59.710691+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.710691+0000","last_undegraded":"2023-09-28T00:22:59.710691+0000","last_fullsized":"2023-09-28T00:22:59.710691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706526+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.706526+0000","last_peered":"2023-09-28T00:22:59.706526+0000","last_clean":"2023-09-28T00:22:59.706526+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.706526+0000","last_undegraded":"2023-09-28T00:22:59.706526+0000","last_fullsized":"2023-09-28T00:22:59.706526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13284,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358556,"statfs":{"total":96636764160,"available":96623161344,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7040000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5419999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5840000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8088,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363752,"statfs":{"total":96636764160,"available":96628482048,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:11.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:11.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.945+0000 7f47b899d700 1 Processor -- start 2023-09-28T00:23:11.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.945+0000 7f47b899d700 1 -- start start 2023-09-28T00:23:11.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.946+0000 7f47b899d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b406cc60 0x7f47b41568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.946+0000 7f47b899d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f47b40c71f0 0x7f47b40c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.946+0000 7f47b899d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b41557c0 con 0x7f47b4068990 2023-09-28T00:23:11.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.946+0000 7f47b899d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b406c7d0 con 0x7f47b40c71f0 2023-09-28T00:23:11.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.946+0000 7f47b899d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40635f0 con 0x7f47b406cc60 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b37fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f47b4068990 0x7f47b4068d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58646/0 (socket says 172.21.15.53:58646) 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b37fe700 1 -- 172.21.15.53:0/3764286577 learned_addr learned my addr 172.21.15.53:0/3764286577 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b2ffd700 1 --2- 172.21.15.53:0/3764286577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b406cc60 0x7f47b41568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b3fff700 1 --2- 172.21.15.53:0/3764286577 >> v2:172.21.15.118:3300/0 conn(0x7f47b40c71f0 0x7f47b40c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b27fc700 1 -- 172.21.15.53:0/3764286577 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377606098 0 0) 0x7f47b41557c0 con 0x7f47b4068990 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b27fc700 1 -- 172.21.15.53:0/3764286577 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c003570 con 0x7f47b4068990 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b2ffd700 1 -- 172.21.15.53:0/3764286577 >> v2:172.21.15.118:3300/0 conn(0x7f47b40c71f0 msgr2=0x7f47b40c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b2ffd700 1 --2- 172.21.15.53:0/3764286577 >> v2:172.21.15.118:3300/0 conn(0x7f47b40c71f0 0x7f47b40c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b2ffd700 1 -- 172.21.15.53:0/3764286577 >> v1:172.21.15.53:6789/0 conn(0x7f47b4068990 legacy=0x7f47b4068d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b2ffd700 1 -- 172.21.15.53:0/3764286577 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b406bbc0 con 0x7f47b406cc60 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.947+0000 7f47b2ffd700 1 --2- 172.21.15.53:0/3764286577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b406cc60 0x7f47b41568f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47a80098e0 tx=0x7f47a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4ac567bca35fd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:11.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b27fc700 1 -- 172.21.15.53:0/3764286577 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8011630 con 0x7f47b406cc60 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b27fc700 1 -- 172.21.15.53:0/3764286577 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8011790 con 0x7f47b406cc60 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b27fc700 1 -- 172.21.15.53:0/3764286577 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8011b30 con 0x7f47b406cc60 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 -- 172.21.15.53:0/3764286577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b406cc60 msgr2=0x7f47b41568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 --2- 172.21.15.53:0/3764286577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b406cc60 0x7f47b41568f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47a80098e0 tx=0x7f47a80091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 -- 172.21.15.53:0/3764286577 shutdown_connections 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 --2- 172.21.15.53:0/3764286577 >> v2:172.21.15.118:3300/0 conn(0x7f47b40c71f0 0x7f47b40c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 --2- 172.21.15.53:0/3764286577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b406cc60 0x7f47b41568f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 -- 172.21.15.53:0/3764286577 >> 172.21.15.53:0/3764286577 conn(0x7f47b4067630 msgr2=0x7f47b4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 -- 172.21.15.53:0/3764286577 shutdown_connections 2023-09-28T00:23:11.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.948+0000 7f47b899d700 1 -- 172.21.15.53:0/3764286577 wait complete. 2023-09-28T00:23:11.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.950+0000 7f47b899d700 1 Processor -- start 2023-09-28T00:23:11.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.950+0000 7f47b899d700 1 -- start start 2023-09-28T00:23:11.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b899d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 0x7f47b41527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b899d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b406cc60 0x7f47b4168770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b899d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b40c71f0 0x7f47b40c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b899d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c0900 con 0x7f47b4068990 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b899d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c32c0 con 0x7f47b406cc60 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b899d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c0340 con 0x7f47b40c71f0 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 0x7f47b41527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 0x7f47b41527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60988/0 (socket says 172.21.15.53:60988) 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 -- 172.21.15.53:0/697785878 learned_addr learned my addr 172.21.15.53:0/697785878 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b2ffd700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b406cc60 0x7f47b4168770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b3fff700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b40c71f0 0x7f47b40c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 -- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b40c71f0 msgr2=0x7f47b40c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b40c71f0 0x7f47b40c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 -- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b406cc60 msgr2=0x7f47b4168770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b406cc60 0x7f47b4168770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.951+0000 7f47b37fe700 1 -- 172.21.15.53:0/697785878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009420 con 0x7f47b4068990 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.952+0000 7f47b37fe700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 0x7f47b41527e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c7c0 tx=0x7f47a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.952+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4005cd0 con 0x7f47b4068990 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.952+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4005e30 con 0x7f47b4068990 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.952+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4007320 con 0x7f47b4068990 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.952+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40c0620 con 0x7f47b4068990 2023-09-28T00:23:11.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.952+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b40c2f50 con 0x7f47b4068990 2023-09-28T00:23:11.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.953+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b40c3110 con 0x7f47b4068990 2023-09-28T00:23:11.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.954+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f47a4007690 con 0x7f47b4068990 2023-09-28T00:23:11.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.955+0000 7f479b7fe700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47a0067330 0x7f47a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:11.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.955+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47a40841f0 con 0x7f47b4068990 2023-09-28T00:23:11.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.955+0000 7f47b2ffd700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47a0067330 0x7f47a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:11.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.956+0000 7f47b2ffd700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47a0067330 0x7f47a00697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f47a80091e0 tx=0x7f47a8017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:11.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:11.959+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f47a40510f0 con 0x7f47b4068990 2023-09-28T00:23:12.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.155+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47b40c3400 con 0x7f47a0067330 2023-09-28T00:23:12.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.164+0000 7f479b7fe700 1 -- 172.21.15.53:0/697785878 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284717 (secure 0 0 0) 0x7f47a8011900 con 0x7f47a0067330 2023-09-28T00:23:12.167 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47a0067330 msgr2=0x7f47a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47a0067330 0x7f47a00697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f47a80091e0 tx=0x7f47a8017000 comp rx=0 tx=0).stop 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 msgr2=0x7f47b41527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 0x7f47b41527e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c7c0 tx=0x7f47a4007e00 comp rx=0 tx=0).stop 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 shutdown_connections 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f47a0067330 0x7f47a00697e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b40c71f0 0x7f47b40c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47b4068990 0x7f47b41527e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 --2- 172.21.15.53:0/697785878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b406cc60 0x7f47b4168770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 >> 172.21.15.53:0/697785878 conn(0x7f47b4067630 msgr2=0x7f47b40c5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:12.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 shutdown_connections 2023-09-28T00:23:12.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.169+0000 7f47b899d700 1 -- 172.21.15.53:0/697785878 wait complete. 2023-09-28T00:23:12.171 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:12.186 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-09-28T00:23:11.104538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83496,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80000,"kb_avail":754891224,"statfs":{"total":773094113280,"available":773008613376,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81920000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7626,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.414943"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711001+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.711001+0000","last_peered":"2023-09-28T00:22:59.711001+0000","last_clean":"2023-09-28T00:22:59.711001+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.711001+0000","last_undegraded":"2023-09-28T00:22:59.711001+0000","last_fullsized":"2023-09-28T00:22:59.711001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706544+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.706544+0000","last_peered":"2023-09-28T00:22:59.706544+0000","last_clean":"2023-09-28T00:22:59.706544+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.706544+0000","last_undegraded":"2023-09-28T00:22:59.706544+0000","last_fullsized":"2023-09-28T00:22:59.706544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.699416+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.699416+0000","last_peered":"2023-09-28T00:22:59.699416+0000","last_clean":"2023-09-28T00:22:59.699416+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.699416+0000","last_undegraded":"2023-09-28T00:22:59.699416+0000","last_fullsized":"2023-09-28T00:22:59.699416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706323+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.706323+0000","last_peered":"2023-09-28T00:22:59.706323+0000","last_clean":"2023-09-28T00:22:59.706323+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.706323+0000","last_undegraded":"2023-09-28T00:22:59.706323+0000","last_fullsized":"2023-09-28T00:22:59.706323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717199+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.717199+0000","last_peered":"2023-09-28T00:22:59.717199+0000","last_clean":"2023-09-28T00:22:59.717199+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.717199+0000","last_undegraded":"2023-09-28T00:22:59.717199+0000","last_fullsized":"2023-09-28T00:22:59.717199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706336+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.706336+0000","last_peered":"2023-09-28T00:22:59.706336+0000","last_clean":"2023-09-28T00:22:59.706336+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.706336+0000","last_undegraded":"2023-09-28T00:22:59.706336+0000","last_fullsized":"2023-09-28T00:22:59.706336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717656+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.717656+0000","last_peered":"2023-09-28T00:22:59.717656+0000","last_clean":"2023-09-28T00:22:59.717656+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.717656+0000","last_undegraded":"2023-09-28T00:22:59.717656+0000","last_fullsized":"2023-09-28T00:22:59.717656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713628+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.713628+0000","last_peered":"2023-09-28T00:22:59.713628+0000","last_clean":"2023-09-28T00:22:59.713628+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.713628+0000","last_undegraded":"2023-09-28T00:22:59.713628+0000","last_fullsized":"2023-09-28T00:22:59.713628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721596+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:23:04.721596+0000","last_peered":"2023-09-28T00:23:04.721596+0000","last_clean":"2023-09-28T00:23:04.721596+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:04.721596+0000","last_undegraded":"2023-09-28T00:23:04.721596+0000","last_fullsized":"2023-09-28T00:23:04.721596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721198+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721198+0000","last_peered":"2023-09-28T00:23:03.721198+0000","last_clean":"2023-09-28T00:23:03.721198+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721198+0000","last_undegraded":"2023-09-28T00:23:03.721198+0000","last_fullsized":"2023-09-28T00:23:03.721198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.717925+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:04.717925+0000","last_peered":"2023-09-28T00:23:04.717925+0000","last_clean":"2023-09-28T00:23:04.717925+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:04.717925+0000","last_undegraded":"2023-09-28T00:23:04.717925+0000","last_fullsized":"2023-09-28T00:23:04.717925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.710025+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.710025+0000","last_peered":"2023-09-28T00:23:02.710025+0000","last_clean":"2023-09-28T00:23:02.710025+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.710025+0000","last_undegraded":"2023-09-28T00:23:02.710025+0000","last_fullsized":"2023-09-28T00:23:02.710025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728314+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:23:05.728314+0000","last_peered":"2023-09-28T00:23:05.728314+0000","last_clean":"2023-09-28T00:23:05.728314+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:05.728314+0000","last_undegraded":"2023-09-28T00:23:05.728314+0000","last_fullsized":"2023-09-28T00:23:05.728314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728766+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728766+0000","last_peered":"2023-09-28T00:23:05.728766+0000","last_clean":"2023-09-28T00:23:05.728766+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728766+0000","last_undegraded":"2023-09-28T00:23:05.728766+0000","last_fullsized":"2023-09-28T00:23:05.728766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723035+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.723035+0000","last_peered":"2023-09-28T00:22:59.723035+0000","last_clean":"2023-09-28T00:22:59.723035+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.723035+0000","last_undegraded":"2023-09-28T00:22:59.723035+0000","last_fullsized":"2023-09-28T00:22:59.723035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726359+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726359+0000","last_peered":"2023-09-28T00:23:05.726359+0000","last_clean":"2023-09-28T00:23:05.726359+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726359+0000","last_undegraded":"2023-09-28T00:23:05.726359+0000","last_fullsized":"2023-09-28T00:23:05.726359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720017+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:04.720017+0000","last_peered":"2023-09-28T00:23:04.720017+0000","last_clean":"2023-09-28T00:23:04.720017+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:04.720017+0000","last_undegraded":"2023-09-28T00:23:04.720017+0000","last_fullsized":"2023-09-28T00:23:04.720017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722483+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:04.722483+0000","last_peered":"2023-09-28T00:23:04.722483+0000","last_clean":"2023-09-28T00:23:04.722483+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:04.722483+0000","last_undegraded":"2023-09-28T00:23:04.722483+0000","last_fullsized":"2023-09-28T00:23:04.722483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'17","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722261+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:23:04.722261+0000","last_peered":"2023-09-28T00:23:04.722261+0000","last_clean":"2023-09-28T00:23:04.722261+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:04.722261+0000","last_undegraded":"2023-09-28T00:23:04.722261+0000","last_fullsized":"2023-09-28T00:23:04.722261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188982+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:23:02.188982+0000","last_peered":"2023-09-28T00:23:02.188982+0000","last_clean":"2023-09-28T00:23:02.188982+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:02.188982+0000","last_undegraded":"2023-09-28T00:23:02.188982+0000","last_fullsized":"2023-09-28T00:23:02.188982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728186+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:23:05.728186+0000","last_peered":"2023-09-28T00:23:05.728186+0000","last_clean":"2023-09-28T00:23:05.728186+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:05.728186+0000","last_undegraded":"2023-09-28T00:23:05.728186+0000","last_fullsized":"2023-09-28T00:23:05.728186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715645+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.715645+0000","last_peered":"2023-09-28T00:22:59.715645+0000","last_clean":"2023-09-28T00:22:59.715645+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.715645+0000","last_undegraded":"2023-09-28T00:22:59.715645+0000","last_fullsized":"2023-09-28T00:22:59.715645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721507+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:23:04.721507+0000","last_peered":"2023-09-28T00:23:04.721507+0000","last_clean":"2023-09-28T00:23:04.721507+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:04.721507+0000","last_undegraded":"2023-09-28T00:23:04.721507+0000","last_fullsized":"2023-09-28T00:23:04.721507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723111+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.723111+0000","last_peered":"2023-09-28T00:22:59.723111+0000","last_clean":"2023-09-28T00:22:59.723111+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.723111+0000","last_undegraded":"2023-09-28T00:22:59.723111+0000","last_fullsized":"2023-09-28T00:22:59.723111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718572+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:04.718572+0000","last_peered":"2023-09-28T00:23:04.718572+0000","last_clean":"2023-09-28T00:23:04.718572+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:04.718572+0000","last_undegraded":"2023-09-28T00:23:04.718572+0000","last_fullsized":"2023-09-28T00:23:04.718572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722580+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:04.722580+0000","last_peered":"2023-09-28T00:23:04.722580+0000","last_clean":"2023-09-28T00:23:04.722580+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:04.722580+0000","last_undegraded":"2023-09-28T00:23:04.722580+0000","last_fullsized":"2023-09-28T00:23:04.722580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725840+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725840+0000","last_peered":"2023-09-28T00:23:05.725840+0000","last_clean":"2023-09-28T00:23:05.725840+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725840+0000","last_undegraded":"2023-09-28T00:23:05.725840+0000","last_fullsized":"2023-09-28T00:23:05.725840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723139+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.723139+0000","last_peered":"2023-09-28T00:22:59.723139+0000","last_clean":"2023-09-28T00:22:59.723139+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.723139+0000","last_undegraded":"2023-09-28T00:22:59.723139+0000","last_fullsized":"2023-09-28T00:22:59.723139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720076+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:23:04.720076+0000","last_peered":"2023-09-28T00:23:04.720076+0000","last_clean":"2023-09-28T00:23:04.720076+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:04.720076+0000","last_undegraded":"2023-09-28T00:23:04.720076+0000","last_fullsized":"2023-09-28T00:23:04.720076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720391+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:04.720391+0000","last_peered":"2023-09-28T00:23:04.720391+0000","last_clean":"2023-09-28T00:23:04.720391+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:04.720391+0000","last_undegraded":"2023-09-28T00:23:04.720391+0000","last_fullsized":"2023-09-28T00:23:04.720391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719030+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.719030+0000","last_peered":"2023-09-28T00:23:03.719030+0000","last_clean":"2023-09-28T00:23:03.719030+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.719030+0000","last_undegraded":"2023-09-28T00:23:03.719030+0000","last_fullsized":"2023-09-28T00:23:03.719030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691167+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.691167+0000","last_peered":"2023-09-28T00:22:59.691167+0000","last_clean":"2023-09-28T00:22:59.691167+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.691167+0000","last_undegraded":"2023-09-28T00:22:59.691167+0000","last_fullsized":"2023-09-28T00:22:59.691167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728787+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:05.728787+0000","last_peered":"2023-09-28T00:23:05.728787+0000","last_clean":"2023-09-28T00:23:05.728787+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:05.728787+0000","last_undegraded":"2023-09-28T00:23:05.728787+0000","last_fullsized":"2023-09-28T00:23:05.728787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719836+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.719836+0000","last_peered":"2023-09-28T00:23:03.719836+0000","last_clean":"2023-09-28T00:23:03.719836+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.719836+0000","last_undegraded":"2023-09-28T00:23:03.719836+0000","last_fullsized":"2023-09-28T00:23:03.719836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189439+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:23:02.189439+0000","last_peered":"2023-09-28T00:23:02.189439+0000","last_clean":"2023-09-28T00:23:02.189439+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:02.189439+0000","last_undegraded":"2023-09-28T00:23:02.189439+0000","last_fullsized":"2023-09-28T00:23:02.189439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722475+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:05.722475+0000","last_peered":"2023-09-28T00:23:05.722475+0000","last_clean":"2023-09-28T00:23:05.722475+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:05.722475+0000","last_undegraded":"2023-09-28T00:23:05.722475+0000","last_fullsized":"2023-09-28T00:23:05.722475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718240+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:04.718240+0000","last_peered":"2023-09-28T00:23:04.718240+0000","last_clean":"2023-09-28T00:23:04.718240+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:04.718240+0000","last_undegraded":"2023-09-28T00:23:04.718240+0000","last_fullsized":"2023-09-28T00:23:04.718240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722920+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.722920+0000","last_peered":"2023-09-28T00:22:59.722920+0000","last_clean":"2023-09-28T00:22:59.722920+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.722920+0000","last_undegraded":"2023-09-28T00:22:59.722920+0000","last_fullsized":"2023-09-28T00:22:59.722920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725530+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:23:05.725530+0000","last_peered":"2023-09-28T00:23:05.725530+0000","last_clean":"2023-09-28T00:23:05.725530+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:05.725530+0000","last_undegraded":"2023-09-28T00:23:05.725530+0000","last_fullsized":"2023-09-28T00:23:05.725530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710487+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.710487+0000","last_peered":"2023-09-28T00:22:59.710487+0000","last_clean":"2023-09-28T00:22:59.710487+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.710487+0000","last_undegraded":"2023-09-28T00:22:59.710487+0000","last_fullsized":"2023-09-28T00:22:59.710487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'12","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.727227+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:05.727227+0000","last_peered":"2023-09-28T00:23:05.727227+0000","last_clean":"2023-09-28T00:23:05.727227+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:05.727227+0000","last_undegraded":"2023-09-28T00:23:05.727227+0000","last_fullsized":"2023-09-28T00:23:05.727227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712741+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.712741+0000","last_peered":"2023-09-28T00:22:59.712741+0000","last_clean":"2023-09-28T00:22:59.712741+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.712741+0000","last_undegraded":"2023-09-28T00:22:59.712741+0000","last_fullsized":"2023-09-28T00:22:59.712741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'13","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725695+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:05.725695+0000","last_peered":"2023-09-28T00:23:05.725695+0000","last_clean":"2023-09-28T00:23:05.725695+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:05.725695+0000","last_undegraded":"2023-09-28T00:23:05.725695+0000","last_fullsized":"2023-09-28T00:23:05.725695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710691+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.710691+0000","last_peered":"2023-09-28T00:22:59.710691+0000","last_clean":"2023-09-28T00:22:59.710691+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.710691+0000","last_undegraded":"2023-09-28T00:22:59.710691+0000","last_fullsized":"2023-09-28T00:22:59.710691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706526+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.706526+0000","last_peered":"2023-09-28T00:22:59.706526+0000","last_clean":"2023-09-28T00:22:59.706526+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.706526+0000","last_undegraded":"2023-09-28T00:22:59.706526+0000","last_fullsized":"2023-09-28T00:22:59.706526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13284,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358556,"statfs":{"total":96636764160,"available":96623161344,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7040000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5419999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5840000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8088,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363752,"statfs":{"total":96636764160,"available":96628482048,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:12.192 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T00:23:12.192 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-28T00:23:12.192 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-28T00:23:12.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-28T00:23:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.412+0000 7f5afffff700 1 Processor -- start 2023-09-28T00:23:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.412+0000 7f5afffff700 1 -- start start 2023-09-28T00:23:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.413+0000 7f5afffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b000cc560 0x7f5b001560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.413+0000 7f5afffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b00069ca0 0x7f5b0006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.413+0000 7f5afffff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000ccaa0 con 0x7f5b000add50 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.413+0000 7f5afffff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000ae830 con 0x7f5b00069ca0 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.413+0000 7f5afffff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b00068c00 con 0x7f5b000cc560 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b00069ca0 0x7f5b0006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5afeffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5b000add50 0x7f5b000ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54422/0 (socket says 172.21.15.53:54422) 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b00069ca0 0x7f5b0006a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60998/0 (socket says 172.21.15.53:60998) 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5afeffd700 1 -- 172.21.15.53:0/3621907098 learned_addr learned my addr 172.21.15.53:0/3621907098 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5afe7fc700 1 --2- 172.21.15.53:0/3621907098 >> v2:172.21.15.118:3300/0 conn(0x7f5b000cc560 0x7f5b001560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5afdffb700 1 -- 172.21.15.53:0/3621907098 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230324312 0 0) 0x7f5b000ccaa0 con 0x7f5b000add50 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5afdffb700 1 -- 172.21.15.53:0/3621907098 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae8003570 con 0x7f5b000add50 2023-09-28T00:23:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 -- 172.21.15.53:0/3621907098 >> v2:172.21.15.118:3300/0 conn(0x7f5b000cc560 msgr2=0x7f5b001560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 --2- 172.21.15.53:0/3621907098 >> v2:172.21.15.118:3300/0 conn(0x7f5b000cc560 0x7f5b001560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 -- 172.21.15.53:0/3621907098 >> v1:172.21.15.118:6789/0 conn(0x7f5b000add50 legacy=0x7f5b000ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 -- 172.21.15.53:0/3621907098 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00068ee0 con 0x7f5b00069ca0 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.414+0000 7f5aff7fe700 1 --2- 172.21.15.53:0/3621907098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b00069ca0 0x7f5b0006a100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b0006a920 tx=0x7f5af8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bae3469e52e2528 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afdffb700 1 -- 172.21.15.53:0/3621907098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800e070 con 0x7f5b00069ca0 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afdffb700 1 -- 172.21.15.53:0/3621907098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800bb40 con 0x7f5b00069ca0 2023-09-28T00:23:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afdffb700 1 -- 172.21.15.53:0/3621907098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8012430 con 0x7f5b00069ca0 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 -- 172.21.15.53:0/3621907098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b00069ca0 msgr2=0x7f5b0006a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 --2- 172.21.15.53:0/3621907098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b00069ca0 0x7f5b0006a100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5b0006a920 tx=0x7f5af8009780 comp rx=0 tx=0).stop 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 -- 172.21.15.53:0/3621907098 shutdown_connections 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 --2- 172.21.15.53:0/3621907098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b00069ca0 0x7f5b0006a100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 --2- 172.21.15.53:0/3621907098 >> v2:172.21.15.118:3300/0 conn(0x7f5b000cc560 0x7f5b001560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 -- 172.21.15.53:0/3621907098 >> 172.21.15.53:0/3621907098 conn(0x7f5b0006f7f0 msgr2=0x7f5b000cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 -- 172.21.15.53:0/3621907098 shutdown_connections 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.415+0000 7f5afffff700 1 -- 172.21.15.53:0/3621907098 wait complete. 2023-09-28T00:23:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.417+0000 7f5afffff700 1 Processor -- start 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.417+0000 7f5afffff700 1 -- start start 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 0x7f5b00158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b000add50 0x7f5b00168a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000cc560 0x7f5b00168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afffff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000c0bf0 con 0x7f5b000cc560 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afffff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000c0310 con 0x7f5b00069ca0 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afffff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000bfe80 con 0x7f5b000add50 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 0x7f5b00158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5aff7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000cc560 0x7f5b00168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 0x7f5b00158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:35026/0 (socket says 172.21.15.53:35026) 2023-09-28T00:23:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 -- 172.21.15.53:0/3173877366 learned_addr learned my addr 172.21.15.53:0/3173877366 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afe7fc700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b000add50 0x7f5b00168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 -- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b000add50 msgr2=0x7f5b00168a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b000add50 0x7f5b00168a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 -- 172.21.15.53:0/3173877366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000cc560 msgr2=0x7f5b00168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000cc560 0x7f5b00168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.418+0000 7f5afeffd700 1 -- 172.21.15.53:0/3173877366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8009a20 con 0x7f5b00069ca0 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.419+0000 7f5afeffd700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 0x7f5b00158d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5af000c7f0 tx=0x7f5af0007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.419+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0005b30 con 0x7f5b00069ca0 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.419+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0005c90 con 0x7f5b00069ca0 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.419+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0014ca40 con 0x7f5b00069ca0 2023-09-28T00:23:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.419+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0007320 con 0x7f5b00069ca0 2023-09-28T00:23:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.419+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b000cadb0 con 0x7f5b00069ca0 2023-09-28T00:23:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.420+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0004c3c0 con 0x7f5b00069ca0 2023-09-28T00:23:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.421+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5af001b3b0 con 0x7f5b00069ca0 2023-09-28T00:23:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.422+0000 7f5ae6ffd700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5aec067330 0x7f5aec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.422+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5af0084140 con 0x7f5b00069ca0 2023-09-28T00:23:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.422+0000 7f5afe7fc700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5aec067330 0x7f5aec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.423+0000 7f5afe7fc700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5aec067330 0x7f5aec0697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b00169b20 tx=0x7f5af40091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.427+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5af0050fa0 con 0x7f5b00069ca0 2023-09-28T00:23:12.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.671+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b000ac4c0 con 0x7f5b00069ca0 2023-09-28T00:23:12.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.672+0000 7f5ae6ffd700 1 -- 172.21.15.53:0/3173877366 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5af00545c0 con 0x7f5b00069ca0 2023-09-28T00:23:12.672 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:12.672 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-28T00:23:12.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5aec067330 msgr2=0x7f5aec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5aec067330 0x7f5aec0697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b00169b20 tx=0x7f5af40091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 msgr2=0x7f5b00158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 0x7f5b00158d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5af000c7f0 tx=0x7f5af0007e00 comp rx=0 tx=0).stop 2023-09-28T00:23:12.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 shutdown_connections 2023-09-28T00:23:12.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5aec067330 0x7f5aec0697e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b000cc560 0x7f5b00168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b00069ca0 0x7f5b00158d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 --2- 172.21.15.53:0/3173877366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b000add50 0x7f5b00168a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 >> 172.21.15.53:0/3173877366 conn(0x7f5b0006f7f0 msgr2=0x7f5b0014f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:12.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 shutdown_connections 2023-09-28T00:23:12.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.674+0000 7f5afffff700 1 -- 172.21.15.53:0/3173877366 wait complete. 2023-09-28T00:23:12.691 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-28T00:23:12.691 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:12.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.879+0000 7f7b9979d700 1 Processor -- start 2023-09-28T00:23:12.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.879+0000 7f7b9979d700 1 -- start start 2023-09-28T00:23:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.880+0000 7f7b9979d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b940add50 0x7f7b941560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.880+0000 7f7b9979d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b940cc560 0x7f7b940ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.880+0000 7f7b9979d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940ccaa0 con 0x7f7b94069ca0 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.880+0000 7f7b9979d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b94068c00 con 0x7f7b940cc560 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.880+0000 7f7b9979d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b94068ee0 con 0x7f7b940add50 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b93fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b940add50 0x7f7b941560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b8b7fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b940cc560 0x7f7b940ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b98f9c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7b94069ca0 0x7f7b9414f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54434/0 (socket says 172.21.15.53:54434) 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b98f9c700 1 -- 172.21.15.53:0/2894698589 learned_addr learned my addr 172.21.15.53:0/2894698589 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b937fe700 1 -- 172.21.15.53:0/2894698589 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738053711 0 0) 0x7f7b940ccaa0 con 0x7f7b94069ca0 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b937fe700 1 -- 172.21.15.53:0/2894698589 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b80003570 con 0x7f7b94069ca0 2023-09-28T00:23:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/2894698589 >> v2:172.21.15.118:3300/0 conn(0x7f7b940add50 msgr2=0x7f7b941560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b8b7fe700 1 --2- 172.21.15.53:0/2894698589 >> v2:172.21.15.118:3300/0 conn(0x7f7b940add50 0x7f7b941560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/2894698589 >> v1:172.21.15.118:6789/0 conn(0x7f7b94069ca0 legacy=0x7f7b9414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/2894698589 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940691c0 con 0x7f7b940cc560 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b93fff700 1 --2- 172.21.15.53:0/2894698589 >> v2:172.21.15.118:3300/0 conn(0x7f7b940add50 0x7f7b941560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b8b7fe700 1 --2- 172.21.15.53:0/2894698589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940cc560 0x7f7b940ae120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b94071520 tx=0x7f7b7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61901534ee81aafe server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.881+0000 7f7b937fe700 1 -- 172.21.15.53:0/2894698589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011630 con 0x7f7b940cc560 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b937fe700 1 -- 172.21.15.53:0/2894698589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0117b0 con 0x7f7b940cc560 2023-09-28T00:23:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b937fe700 1 -- 172.21.15.53:0/2894698589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011b70 con 0x7f7b940cc560 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 -- 172.21.15.53:0/2894698589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940cc560 msgr2=0x7f7b940ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 --2- 172.21.15.53:0/2894698589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940cc560 0x7f7b940ae120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b94071520 tx=0x7f7b7c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 -- 172.21.15.53:0/2894698589 shutdown_connections 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 --2- 172.21.15.53:0/2894698589 >> v2:172.21.15.118:3300/0 conn(0x7f7b940add50 0x7f7b941560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 --2- 172.21.15.53:0/2894698589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940cc560 0x7f7b940ae120 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 -- 172.21.15.53:0/2894698589 >> 172.21.15.53:0/2894698589 conn(0x7f7b9406f7f0 msgr2=0x7f7b940cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 -- 172.21.15.53:0/2894698589 shutdown_connections 2023-09-28T00:23:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.882+0000 7f7b9979d700 1 -- 172.21.15.53:0/2894698589 wait complete. 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.884+0000 7f7b9979d700 1 Processor -- start 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.884+0000 7f7b9979d700 1 -- start start 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b9979d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b94069ca0 0x7f7b941695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b9979d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 0x7f7b94158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b9979d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b940cc560 0x7f7b940afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b9979d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940c62f0 con 0x7f7b940add50 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b9979d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940aec20 con 0x7f7b94069ca0 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b9979d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940afa40 con 0x7f7b940cc560 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 0x7f7b94158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 0x7f7b94158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32784/0 (socket says 172.21.15.53:32784) 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/4099906871 learned_addr learned my addr 172.21.15.53:0/4099906871 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b93fff700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b94069ca0 0x7f7b941695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b98f9c700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b940cc560 0x7f7b940afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b940cc560 msgr2=0x7f7b940afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b940cc560 0x7f7b940afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b94069ca0 msgr2=0x7f7b941695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b94069ca0 0x7f7b941695d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.885+0000 7f7b8b7fe700 1 -- 172.21.15.53:0/4099906871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c009420 con 0x7f7b940add50 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.886+0000 7f7b8b7fe700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 0x7f7b94158f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b94088f60 tx=0x7f7b7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.886+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c01f070 con 0x7f7b940add50 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.886+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c000bc0 con 0x7f7b940add50 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.886+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c009420 con 0x7f7b940add50 2023-09-28T00:23:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.886+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011b70 con 0x7f7b940add50 2023-09-28T00:23:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.886+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b940af110 con 0x7f7b940add50 2023-09-28T00:23:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.887+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9404c3c0 con 0x7f7b940add50 2023-09-28T00:23:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.888+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7b7c023070 con 0x7f7b940add50 2023-09-28T00:23:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.888+0000 7f7b90ff9700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7b74067330 0x7f7b740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.889+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7b7c0859d0 con 0x7f7b940add50 2023-09-28T00:23:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.889+0000 7f7b93fff700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7b74067330 0x7f7b740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.889+0000 7f7b93fff700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7b74067330 0x7f7b740697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009f40 tx=0x7f7b8c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:12.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:12.893+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7b7c052830 con 0x7f7b940add50 2023-09-28T00:23:13.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.097+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b940afb80 con 0x7f7b940add50 2023-09-28T00:23:13.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.098+0000 7f7b90ff9700 1 -- 172.21.15.53:0/4099906871 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f7b7c055e50 con 0x7f7b940add50 2023-09-28T00:23:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:13.098 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7b74067330 msgr2=0x7f7b740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7b74067330 0x7f7b740697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009f40 tx=0x7f7b8c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 msgr2=0x7f7b94158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 0x7f7b94158f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b94088f60 tx=0x7f7b7c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 shutdown_connections 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7b74067330 0x7f7b740697e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b940cc560 0x7f7b940afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b94069ca0 0x7f7b941695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 --2- 172.21.15.53:0/4099906871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940add50 0x7f7b94158f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 >> 172.21.15.53:0/4099906871 conn(0x7f7b9406f7f0 msgr2=0x7f7b9414e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 shutdown_connections 2023-09-28T00:23:13.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.100+0000 7f7b9979d700 1 -- 172.21.15.53:0/4099906871 wait complete. 2023-09-28T00:23:13.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:22:45.151575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:22:52.312450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-28T00:22:58.139047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-28T00:22:58.662077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-28T00:23:13.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:23:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.310+0000 7f201919d700 1 Processor -- start 2023-09-28T00:23:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.311+0000 7f201919d700 1 -- start start 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f201919d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20140c1640 0x7f20140c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f201919d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2014156af0 con 0x7f201414d970 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f201919d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2014153eb0 con 0x7f201414d5a0 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f201919d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2014154410 con 0x7f20140c1640 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f20137fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20140c1640 0x7f20140c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f20137fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20140c1640 0x7f20140c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32788/0 (socket says 172.21.15.53:32788) 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f20137fe700 1 -- 172.21.15.53:0/129537799 learned_addr learned my addr 172.21.15.53:0/129537799 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.312+0000 7f201899c700 1 --1- 172.21.15.53:0/129537799 >> v1:172.21.15.53:6789/0 conn(0x7f201414d970 0x7f2014156f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58662/0 (socket says 172.21.15.53:58662) 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f20137fe700 1 -- 172.21.15.53:0/129537799 >> v1:172.21.15.118:6789/0 conn(0x7f201414d5a0 legacy=0x7f20140c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f20137fe700 1 -- 172.21.15.53:0/129537799 >> v1:172.21.15.53:6789/0 conn(0x7f201414d970 legacy=0x7f2014156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f20137fe700 1 -- 172.21.15.53:0/129537799 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014154130 con 0x7f20140c1640 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f2012ffd700 1 -- 172.21.15.53:0/129537799 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018908136 0 0) 0x7f2014153eb0 con 0x7f201414d5a0 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f20137fe700 1 --2- 172.21.15.53:0/129537799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20140c1640 0x7f20140c22b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20080099b0 tx=0x7f2008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b551c774c2b74e00 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f2012ffd700 1 -- 172.21.15.53:0/129537799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200800b760 con 0x7f20140c1640 2023-09-28T00:23:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f2012ffd700 1 -- 172.21.15.53:0/129537799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200800b8c0 con 0x7f20140c1640 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.313+0000 7f2012ffd700 1 -- 172.21.15.53:0/129537799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200800bc60 con 0x7f20140c1640 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 -- 172.21.15.53:0/129537799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20140c1640 msgr2=0x7f20140c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 --2- 172.21.15.53:0/129537799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20140c1640 0x7f20140c22b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20080099b0 tx=0x7f2008009250 comp rx=0 tx=0).stop 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 -- 172.21.15.53:0/129537799 shutdown_connections 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 --2- 172.21.15.53:0/129537799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20140c1640 0x7f20140c22b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 -- 172.21.15.53:0/129537799 >> 172.21.15.53:0/129537799 conn(0x7f2014067630 msgr2=0x7f2014067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 -- 172.21.15.53:0/129537799 shutdown_connections 2023-09-28T00:23:13.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.314+0000 7f201919d700 1 -- 172.21.15.53:0/129537799 wait complete. 2023-09-28T00:23:13.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.315+0000 7f201919d700 1 Processor -- start 2023-09-28T00:23:13.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.315+0000 7f201919d700 1 -- start start 2023-09-28T00:23:13.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f201919d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20140c1640 0x7f2014146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f201919d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 0x7f201414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f201919d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201414d970 0x7f201414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f201919d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2014163cd0 con 0x7f201414d5a0 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f201919d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2014149b80 con 0x7f201414d970 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f201919d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2014152270 con 0x7f20140c1640 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f20137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 0x7f201414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f20137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 0x7f201414b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32798/0 (socket says 172.21.15.53:32798) 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.316+0000 7f20137fe700 1 -- 172.21.15.53:0/3948405980 learned_addr learned my addr 172.21.15.53:0/3948405980 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f201899c700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201414d970 0x7f201414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f2013fff700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20140c1640 0x7f2014146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f20137fe700 1 -- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20140c1640 msgr2=0x7f2014146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f20137fe700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20140c1640 0x7f2014146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f20137fe700 1 -- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201414d970 msgr2=0x7f201414bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f20137fe700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201414d970 0x7f201414bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f20137fe700 1 -- 172.21.15.53:0/3948405980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080094f0 con 0x7f201414d5a0 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f20137fe700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 0x7f201414b740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2008009290 tx=0x7f2008016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200801c460 con 0x7f201414d5a0 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200801c5e0 con 0x7f201414d5a0 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20141633a0 con 0x7f201414d5a0 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.317+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200801c9a0 con 0x7f201414d5a0 2023-09-28T00:23:13.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.318+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2014163960 con 0x7f201414d5a0 2023-09-28T00:23:13.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.319+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201404c3c0 con 0x7f201414d5a0 2023-09-28T00:23:13.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.319+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f200801a450 con 0x7f201414d5a0 2023-09-28T00:23:13.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.320+0000 7f1ffbfff700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f2000067330 0x7f20000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.320+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2008086fa0 con 0x7f201414d5a0 2023-09-28T00:23:13.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.320+0000 7f2013fff700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f2000067330 0x7f20000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.321+0000 7f2013fff700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f2000067330 0x7f20000697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2004003a90 tx=0x7f2004007ce0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:13.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.324+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2008053e00 con 0x7f201414d5a0 2023-09-28T00:23:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.526+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f201404c3c0 con 0x7f201414d5a0 2023-09-28T00:23:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.526+0000 7f1ffbfff700 1 -- 172.21.15.53:0/3948405980 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2008057420 con 0x7f201414d5a0 2023-09-28T00:23:13.527 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-09-28T00:23:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f2000067330 msgr2=0x7f20000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f2000067330 0x7f20000697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2004003a90 tx=0x7f2004007ce0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 msgr2=0x7f201414b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 0x7f201414b740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2008009290 tx=0x7f2008016000 comp rx=0 tx=0).stop 2023-09-28T00:23:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 shutdown_connections 2023-09-28T00:23:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f2000067330 0x7f20000697e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20140c1640 0x7f2014146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f201414d970 0x7f201414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 --2- 172.21.15.53:0/3948405980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201414d5a0 0x7f201414b740 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 >> 172.21.15.53:0/3948405980 conn(0x7f2014067630 msgr2=0x7f20140c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 shutdown_connections 2023-09-28T00:23:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.529+0000 7f201919d700 1 -- 172.21.15.53:0/3948405980 wait complete. 2023-09-28T00:23:13.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:23:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.735+0000 7f0395d9d700 1 Processor -- start 2023-09-28T00:23:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.735+0000 7f0395d9d700 1 -- start start 2023-09-28T00:23:13.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0395d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03901553c0 0x7f0390068740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0395d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0390068c80 0x7f039015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0395d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039006cc40 con 0x7f039014bf50 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0395d9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03901557f0 con 0x7f0390068c80 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0395d9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0390063710 con 0x7f03901553c0 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f039559c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0390068c80 0x7f039015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0394d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f039014bf50 0x7f03901568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54460/0 (socket says 172.21.15.53:54460) 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f0394d9b700 1 -- 172.21.15.53:0/3415230296 learned_addr learned my addr 172.21.15.53:0/3415230296 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f038ffff700 1 --2- 172.21.15.53:0/3415230296 >> v2:172.21.15.118:3300/0 conn(0x7f03901553c0 0x7f0390068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f039559c700 1 -- 172.21.15.53:0/3415230296 >> v2:172.21.15.118:3300/0 conn(0x7f03901553c0 msgr2=0x7f0390068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f039559c700 1 --2- 172.21.15.53:0/3415230296 >> v2:172.21.15.118:3300/0 conn(0x7f03901553c0 0x7f0390068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f039559c700 1 -- 172.21.15.53:0/3415230296 >> v1:172.21.15.118:6789/0 conn(0x7f039014bf50 legacy=0x7f03901568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f039559c700 1 -- 172.21.15.53:0/3415230296 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390156fd0 con 0x7f0390068c80 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.737+0000 7f038f7fe700 1 -- 172.21.15.53:0/3415230296 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251725988 0 0) 0x7f039006cc40 con 0x7f039014bf50 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f039559c700 1 --2- 172.21.15.53:0/3415230296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f039015fd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f039006f700 tx=0x7f0388009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c9ab3d54f245a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f038f7fe700 1 -- 172.21.15.53:0/3415230296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800e070 con 0x7f0390068c80 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f038f7fe700 1 -- 172.21.15.53:0/3415230296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038800bbf0 con 0x7f0390068c80 2023-09-28T00:23:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f038f7fe700 1 -- 172.21.15.53:0/3415230296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388012430 con 0x7f0390068c80 2023-09-28T00:23:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 -- 172.21.15.53:0/3415230296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 msgr2=0x7f039015fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3415230296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f039015fd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f039006f700 tx=0x7f0388009780 comp rx=0 tx=0).stop 2023-09-28T00:23:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 -- 172.21.15.53:0/3415230296 shutdown_connections 2023-09-28T00:23:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3415230296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f039015fd60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3415230296 >> v2:172.21.15.118:3300/0 conn(0x7f03901553c0 0x7f0390068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 -- 172.21.15.53:0/3415230296 >> 172.21.15.53:0/3415230296 conn(0x7f0390067630 msgr2=0x7f0390067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 -- 172.21.15.53:0/3415230296 shutdown_connections 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.738+0000 7f0395d9d700 1 -- 172.21.15.53:0/3415230296 wait complete. 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.740+0000 7f0395d9d700 1 Processor -- start 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.740+0000 7f0395d9d700 1 -- start start 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0395d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f03901473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0395d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f039014bf50 0x7f039015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0395d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03901553c0 0x7f039014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0395d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900c6ec0 con 0x7f0390068c80 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0395d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900bfcc0 con 0x7f03901553c0 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0395d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03900c6640 con 0x7f039014bf50 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f03901473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f03901473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32824/0 (socket says 172.21.15.53:32824) 2023-09-28T00:23:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 -- 172.21.15.53:0/3191750025 learned_addr learned my addr 172.21.15.53:0/3191750025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f039559c700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03901553c0 0x7f039014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f038ffff700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f039014bf50 0x7f039015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 -- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f039014bf50 msgr2=0x7f039015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f039014bf50 0x7f039015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 -- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03901553c0 msgr2=0x7f039014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03901553c0 0x7f039014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.741+0000 7f0394d9b700 1 -- 172.21.15.53:0/3191750025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0388009a20 con 0x7f0390068c80 2023-09-28T00:23:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.742+0000 7f0394d9b700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f03901473b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f038400c810 tx=0x7f0384007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.742+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384005b30 con 0x7f0390068c80 2023-09-28T00:23:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.742+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384005c90 con 0x7f0390068c80 2023-09-28T00:23:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.742+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0390147120 con 0x7f0390068c80 2023-09-28T00:23:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.742+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384007300 con 0x7f0390068c80 2023-09-28T00:23:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.742+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03900c6be0 con 0x7f0390068c80 2023-09-28T00:23:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.743+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039004c3c0 con 0x7f0390068c80 2023-09-28T00:23:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.744+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f038401b3b0 con 0x7f0390068c80 2023-09-28T00:23:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.745+0000 7f038cff9700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0374067330 0x7f03740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.745+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03840841c0 con 0x7f0390068c80 2023-09-28T00:23:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.745+0000 7f038ffff700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0374067330 0x7f03740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.746+0000 7f038ffff700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0374067330 0x7f03740697e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03901483e0 tx=0x7f037c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.749+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0384051020 con 0x7f0390068c80 2023-09-28T00:23:13.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.950+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03900c45e0 con 0x7f0390068c80 2023-09-28T00:23:13.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.950+0000 7f038cff9700 1 -- 172.21.15.53:0/3191750025 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0384001d60 con 0x7f0390068c80 2023-09-28T00:23:13.950 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-09-28T00:23:13.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0374067330 msgr2=0x7f03740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0374067330 0x7f03740697e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03901483e0 tx=0x7f037c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 msgr2=0x7f03901473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f03901473b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f038400c810 tx=0x7f0384007df0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 shutdown_connections 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0374067330 0x7f03740697e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03901553c0 0x7f039014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390068c80 0x7f03901473b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 --2- 172.21.15.53:0/3191750025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f039014bf50 0x7f039015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 >> 172.21.15.53:0/3191750025 conn(0x7f0390067630 msgr2=0x7f039015bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 shutdown_connections 2023-09-28T00:23:13.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:13.952+0000 7f0395d9d700 1 -- 172.21.15.53:0/3191750025 wait complete. 2023-09-28T00:23:13.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-28T00:23:14.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.159+0000 7f607ed9d700 1 Processor -- start 2023-09-28T00:23:14.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.159+0000 7f607ed9d700 1 -- start start 2023-09-28T00:23:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.160+0000 7f607ed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f60780c0e10 0x7f6078159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.160+0000 7f607ed9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60780c11e0 0x7f60780cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.160+0000 7f607ed9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6078156040 con 0x7f60780c16e0 2023-09-28T00:23:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.160+0000 7f607ed9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780c6cf0 con 0x7f60780c11e0 2023-09-28T00:23:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.160+0000 7f607ed9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780c6730 con 0x7f60780c0e10 2023-09-28T00:23:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.160+0000 7f607d59a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60780c11e0 0x7f60780cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60780c11e0 0x7f60780cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32836/0 (socket says 172.21.15.53:32836) 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 -- 172.21.15.53:0/382967032 learned_addr learned my addr 172.21.15.53:0/382967032 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607dd9b700 1 --2- 172.21.15.53:0/382967032 >> v2:172.21.15.118:3300/0 conn(0x7f60780c0e10 0x7f6078159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 -- 172.21.15.53:0/382967032 >> v2:172.21.15.118:3300/0 conn(0x7f60780c0e10 msgr2=0x7f6078159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 --2- 172.21.15.53:0/382967032 >> v2:172.21.15.118:3300/0 conn(0x7f60780c0e10 0x7f6078159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 -- 172.21.15.53:0/382967032 >> v1:172.21.15.118:6789/0 conn(0x7f60780c16e0 legacy=0x7f607813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 -- 172.21.15.53:0/382967032 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780c6a10 con 0x7f60780c11e0 2023-09-28T00:23:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607d59a700 1 --2- 172.21.15.53:0/382967032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c11e0 0x7f60780cc580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60780896d0 tx=0x7f6068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5c20c04b675d4f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607cd99700 1 -- 172.21.15.53:0/382967032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068009e70 con 0x7f60780c11e0 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607cd99700 1 -- 172.21.15.53:0/382967032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800b860 con 0x7f60780c11e0 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.161+0000 7f607cd99700 1 -- 172.21.15.53:0/382967032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800bc00 con 0x7f60780c11e0 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 -- 172.21.15.53:0/382967032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c11e0 msgr2=0x7f60780cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 --2- 172.21.15.53:0/382967032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c11e0 0x7f60780cc580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60780896d0 tx=0x7f6068009250 comp rx=0 tx=0).stop 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 -- 172.21.15.53:0/382967032 shutdown_connections 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 --2- 172.21.15.53:0/382967032 >> v2:172.21.15.118:3300/0 conn(0x7f60780c0e10 0x7f6078159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 --2- 172.21.15.53:0/382967032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c11e0 0x7f60780cc580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 -- 172.21.15.53:0/382967032 >> 172.21.15.53:0/382967032 conn(0x7f607806f830 msgr2=0x7f60780cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 -- 172.21.15.53:0/382967032 shutdown_connections 2023-09-28T00:23:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.162+0000 7f607ed9d700 1 -- 172.21.15.53:0/382967032 wait complete. 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.163+0000 7f607ed9d700 1 Processor -- start 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.164+0000 7f607ed9d700 1 -- start start 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.164+0000 7f607ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 0x7f60780c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.164+0000 7f607ed9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60780c11e0 0x7f60780cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.164+0000 7f607ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60780c16e0 0x7f60780c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607ed9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078165a20 con 0x7f60780c0e10 2023-09-28T00:23:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607ed9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781669f0 con 0x7f60780c16e0 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607ed9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6078166560 con 0x7f60780c11e0 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 0x7f60780c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 0x7f60780c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32846/0 (socket says 172.21.15.53:32846) 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 -- 172.21.15.53:0/3970332791 learned_addr learned my addr 172.21.15.53:0/3970332791 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607e59c700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60780c16e0 0x7f60780c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607d59a700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60780c11e0 0x7f60780cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 -- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60780c11e0 msgr2=0x7f60780cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60780c11e0 0x7f60780cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 -- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60780c16e0 msgr2=0x7f60780c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60780c16e0 0x7f60780c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 -- 172.21.15.53:0/3970332791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680094f0 con 0x7f60780c0e10 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.165+0000 7f607dd9b700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 0x7f60780c5380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f607400ec80 tx=0x7f60740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.166+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400c7f0 con 0x7f60780c0e10 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.166+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607400c950 con 0x7f60780c0e10 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.166+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078152f90 con 0x7f60780c0e10 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.166+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400ccf0 con 0x7f60780c0e10 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.166+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078165f10 con 0x7f60780c0e10 2023-09-28T00:23:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.167+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607804c3c0 con 0x7f60780c0e10 2023-09-28T00:23:14.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.168+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6074013680 con 0x7f60780c0e10 2023-09-28T00:23:14.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.168+0000 7f606dffb700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f605c067330 0x7f605c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.169+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6074084de0 con 0x7f60780c0e10 2023-09-28T00:23:14.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.169+0000 7f607d59a700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f605c067330 0x7f605c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.169+0000 7f607d59a700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f605c067330 0x7f605c0697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60780896d0 tx=0x7f6068017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:14.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.172+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6074051c40 con 0x7f60780c0e10 2023-09-28T00:23:14.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.376+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6078166840 con 0x7f60780c0e10 2023-09-28T00:23:14.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.376+0000 7f606dffb700 1 -- 172.21.15.53:0/3970332791 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6074055260 con 0x7f60780c0e10 2023-09-28T00:23:14.376 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-09-28T00:23:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f605c067330 msgr2=0x7f605c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f605c067330 0x7f605c0697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60780896d0 tx=0x7f6068017000 comp rx=0 tx=0).stop 2023-09-28T00:23:14.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 msgr2=0x7f60780c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 0x7f60780c5380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f607400ec80 tx=0x7f60740091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 shutdown_connections 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f605c067330 0x7f605c0697e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60780c16e0 0x7f60780c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60780c0e10 0x7f60780c5380 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 --2- 172.21.15.53:0/3970332791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60780c11e0 0x7f60780cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 >> 172.21.15.53:0/3970332791 conn(0x7f607806f830 msgr2=0x7f607813b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 shutdown_connections 2023-09-28T00:23:14.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.379+0000 7f607ed9d700 1 -- 172.21.15.53:0/3970332791 wait complete. 2023-09-28T00:23:14.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-28T00:23:14.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.586+0000 7efcf7fff700 1 Processor -- start 2023-09-28T00:23:14.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.586+0000 7efcf7fff700 1 -- start start 2023-09-28T00:23:14.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcf806c550 0x7efcf8155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf7fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf806cab0 con 0x7efcf814f7c0 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf7fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf8158cf0 con 0x7efcf8155c90 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf7fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80c5070 con 0x7efcf806c550 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf67fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcf806c550 0x7efcf8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf6ffd700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efcf814f7c0 0x7efcf806f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58676/0 (socket says 172.21.15.53:58676) 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf6ffd700 1 -- 172.21.15.53:0/3573774121 learned_addr learned my addr 172.21.15.53:0/3573774121 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf67fc700 1 -- 172.21.15.53:0/3573774121 >> v1:172.21.15.118:6789/0 conn(0x7efcf8155c90 legacy=0x7efcf815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf67fc700 1 -- 172.21.15.53:0/3573774121 >> v1:172.21.15.53:6789/0 conn(0x7efcf814f7c0 legacy=0x7efcf806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.588+0000 7efcf67fc700 1 -- 172.21.15.53:0/3573774121 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8158fd0 con 0x7efcf806c550 2023-09-28T00:23:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.589+0000 7efcf67fc700 1 --2- 172.21.15.53:0/3573774121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf806c550 0x7efcf8155750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efcec009860 tx=0x7efcec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32828004613c05e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:14.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.589+0000 7efcf5ffb700 1 -- 172.21.15.53:0/3573774121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec010590 con 0x7efcf806c550 2023-09-28T00:23:14.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.589+0000 7efcf5ffb700 1 -- 172.21.15.53:0/3573774121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec0106f0 con 0x7efcf806c550 2023-09-28T00:23:14.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.589+0000 7efcf5ffb700 1 -- 172.21.15.53:0/3573774121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec010a90 con 0x7efcf806c550 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.589+0000 7efcf7fff700 1 -- 172.21.15.53:0/3573774121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf806c550 msgr2=0x7efcf8155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.589+0000 7efcf7fff700 1 --2- 172.21.15.53:0/3573774121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf806c550 0x7efcf8155750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efcec009860 tx=0x7efcec0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.590+0000 7efcf7fff700 1 -- 172.21.15.53:0/3573774121 shutdown_connections 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.590+0000 7efcf7fff700 1 --2- 172.21.15.53:0/3573774121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf806c550 0x7efcf8155750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.590+0000 7efcf7fff700 1 -- 172.21.15.53:0/3573774121 >> 172.21.15.53:0/3573774121 conn(0x7efcf8068740 msgr2=0x7efcf8068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.590+0000 7efcf7fff700 1 -- 172.21.15.53:0/3573774121 shutdown_connections 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.590+0000 7efcf7fff700 1 -- 172.21.15.53:0/3573774121 wait complete. 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.591+0000 7efcf7fff700 1 Processor -- start 2023-09-28T00:23:14.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.591+0000 7efcf7fff700 1 -- start start 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf806c550 0x7efcf814d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf814f7c0 0x7efcf80c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 0x7efcf80c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf7fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8159970 con 0x7efcf8155c90 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf7fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8149510 con 0x7efcf806c550 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf7fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c12f0 con 0x7efcf814f7c0 2023-09-28T00:23:14.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 0x7efcf80c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 0x7efcf80c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32872/0 (socket says 172.21.15.53:32872) 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf77fe700 1 -- 172.21.15.53:0/1801348197 learned_addr learned my addr 172.21.15.53:0/1801348197 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf6ffd700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf806c550 0x7efcf814d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.592+0000 7efcf67fc700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf814f7c0 0x7efcf80c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf77fe700 1 -- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf814f7c0 msgr2=0x7efcf80c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf77fe700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf814f7c0 0x7efcf80c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf77fe700 1 -- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf806c550 msgr2=0x7efcf814d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf77fe700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf806c550 0x7efcf814d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf77fe700 1 -- 172.21.15.53:0/1801348197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009420 con 0x7efcf8155c90 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf77fe700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 0x7efcf80c1cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efcf000c960 tx=0x7efcf0001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:14.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0012630 con 0x7efcf8155c90 2023-09-28T00:23:14.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0012790 con 0x7efcf8155c90 2023-09-28T00:23:14.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf80c26b0 con 0x7efcf8155c90 2023-09-28T00:23:14.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0012b50 con 0x7efcf8155c90 2023-09-28T00:23:14.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.593+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf806f7a0 con 0x7efcf8155c90 2023-09-28T00:23:14.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.594+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf80c14a0 con 0x7efcf8155c90 2023-09-28T00:23:14.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.595+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efcf0003030 con 0x7efcf8155c90 2023-09-28T00:23:14.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.596+0000 7efcdeffd700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efce4067330 0x7efce40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:14.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.596+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcf0084cb0 con 0x7efcf8155c90 2023-09-28T00:23:14.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.596+0000 7efcf6ffd700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efce4067330 0x7efce40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:14.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.597+0000 7efcf6ffd700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efce4067330 0x7efce40697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efce8007160 tx=0x7efce8007ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.600+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efcf80c14a0 con 0x7efcf8155c90 2023-09-28T00:23:14.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.803+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcf804c430 con 0x7efcf8155c90 2023-09-28T00:23:14.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.804+0000 7efcdeffd700 1 -- 172.21.15.53:0/1801348197 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcf804c430 con 0x7efcf8155c90 2023-09-28T00:23:14.804 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-09-28T00:23:14.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efce4067330 msgr2=0x7efce40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efce4067330 0x7efce40697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efce8007160 tx=0x7efce8007ef0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 msgr2=0x7efcf80c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 0x7efcf80c1cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efcf000c960 tx=0x7efcf0001740 comp rx=0 tx=0).stop 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 shutdown_connections 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efce4067330 0x7efce40697e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcf8155c90 0x7efcf80c1cc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf806c550 0x7efcf814d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 --2- 172.21.15.53:0/1801348197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf814f7c0 0x7efcf80c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 >> 172.21.15.53:0/1801348197 conn(0x7efcf8068740 msgr2=0x7efcf814e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 shutdown_connections 2023-09-28T00:23:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:14.806+0000 7efcf7fff700 1 -- 172.21.15.53:0/1801348197 wait complete. 2023-09-28T00:23:14.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:23:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.010+0000 7f5333fff700 1 Processor -- start 2023-09-28T00:23:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.010+0000 7f5333fff700 1 -- start start 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.011+0000 7f5333fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f53340cc560 0x7f53341560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.011+0000 7f5333fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5334069ca0 0x7f533406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.011+0000 7f5333fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340ccaa0 con 0x7f53340add50 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.011+0000 7f5333fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53340ae830 con 0x7f53340cc560 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.011+0000 7f5333fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5334068c00 con 0x7f5334069ca0 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.011+0000 7f5332ffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f53340add50 0x7f53340ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:54480/0 (socket says 172.21.15.53:54480) 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f5332ffd700 1 -- 172.21.15.53:0/3196955875 learned_addr learned my addr 172.21.15.53:0/3196955875 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53327fc700 1 --2- 172.21.15.53:0/3196955875 >> v2:172.21.15.53:3300/0 conn(0x7f53340cc560 0x7f53341560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53337fe700 1 --2- 172.21.15.53:0/3196955875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5334069ca0 0x7f533406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f5331ffb700 1 -- 172.21.15.53:0/3196955875 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521611997 0 0) 0x7f53340ccaa0 con 0x7f53340add50 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f5331ffb700 1 -- 172.21.15.53:0/3196955875 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f531c003570 con 0x7f53340add50 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53327fc700 1 -- 172.21.15.53:0/3196955875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5334069ca0 msgr2=0x7f533406a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53327fc700 1 --2- 172.21.15.53:0/3196955875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5334069ca0 0x7f533406a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53327fc700 1 -- 172.21.15.53:0/3196955875 >> v1:172.21.15.118:6789/0 conn(0x7f53340add50 legacy=0x7f53340ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53327fc700 1 -- 172.21.15.53:0/3196955875 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334068ee0 con 0x7f53340cc560 2023-09-28T00:23:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f53327fc700 1 --2- 172.21.15.53:0/3196955875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53340cc560 0x7f53341560f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53280098e0 tx=0x7f53280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a3d5e0a3cf62d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.012+0000 7f5331ffb700 1 -- 172.21.15.53:0/3196955875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011630 con 0x7f53340cc560 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5331ffb700 1 -- 172.21.15.53:0/3196955875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328011790 con 0x7f53340cc560 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5331ffb700 1 -- 172.21.15.53:0/3196955875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011b30 con 0x7f53340cc560 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 -- 172.21.15.53:0/3196955875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53340cc560 msgr2=0x7f53341560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 --2- 172.21.15.53:0/3196955875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53340cc560 0x7f53341560f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53280098e0 tx=0x7f53280091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 -- 172.21.15.53:0/3196955875 shutdown_connections 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 --2- 172.21.15.53:0/3196955875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5334069ca0 0x7f533406a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 --2- 172.21.15.53:0/3196955875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53340cc560 0x7f53341560f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 -- 172.21.15.53:0/3196955875 >> 172.21.15.53:0/3196955875 conn(0x7f533406f7f0 msgr2=0x7f53340cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 -- 172.21.15.53:0/3196955875 shutdown_connections 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.013+0000 7f5333fff700 1 -- 172.21.15.53:0/3196955875 wait complete. 2023-09-28T00:23:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.015+0000 7f5333fff700 1 Processor -- start 2023-09-28T00:23:15.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.015+0000 7f5333fff700 1 -- start start 2023-09-28T00:23:15.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5333fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 0x7f5334166210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5333fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340add50 0x7f533414e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5333fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340cc560 0x7f53340b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5333fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340b0710 con 0x7f5334069ca0 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5333fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334165d80 con 0x7f53340add50 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5333fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340af5c0 con 0x7f53340cc560 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 0x7f5334166210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 0x7f5334166210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32898/0 (socket says 172.21.15.53:32898) 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 -- 172.21.15.53:0/3567015074 learned_addr learned my addr 172.21.15.53:0/3567015074 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f53337fe700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340cc560 0x7f53340b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f53327fc700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340add50 0x7f533414e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 -- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340cc560 msgr2=0x7f53340b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340cc560 0x7f53340b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 -- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340add50 msgr2=0x7f533414e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340add50 0x7f533414e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.016+0000 7f5332ffd700 1 -- 172.21.15.53:0/3567015074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5328009420 con 0x7f5334069ca0 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.017+0000 7f5332ffd700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 0x7f5334166210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f532400c7c0 tx=0x7f5324007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.017+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324005cd0 con 0x7f5334069ca0 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.017+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324005e30 con 0x7f5334069ca0 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.017+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324007320 con 0x7f5334069ca0 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.017+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5334169a70 con 0x7f5334069ca0 2023-09-28T00:23:15.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.017+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5334150350 con 0x7f5334069ca0 2023-09-28T00:23:15.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.018+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334063660 con 0x7f5334069ca0 2023-09-28T00:23:15.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.019+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f532401b3b0 con 0x7f5334069ca0 2023-09-28T00:23:15.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.020+0000 7f531affd700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5320067360 0x7f5320069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.020+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f53240842c0 con 0x7f5334069ca0 2023-09-28T00:23:15.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.020+0000 7f53327fc700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5320067360 0x7f5320069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.021+0000 7f53327fc700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5320067360 0x7f5320069810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f53280091e0 tx=0x7f5328017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.024+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5324051120 con 0x7f5334069ca0 2023-09-28T00:23:15.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.272+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f533404c3c0 con 0x7f5334069ca0 2023-09-28T00:23:15.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.273+0000 7f531affd700 1 -- 172.21.15.53:0/3567015074 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6168 (secure 0 0 0) 0x7f5324054740 con 0x7f5334069ca0 2023-09-28T00:23:15.273 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:15.273 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:22:59.682569+0000","modified":"2023-09-28T00:23:06.715808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4299,"mds_1":4296,"mds_2":4291,"mds_3":4271,"mds_4":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4271":{"gid":4271,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4291":{"gid":4291,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4296":{"gid":4296,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4299":{"gid":4299,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.275+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5320067360 msgr2=0x7f5320069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.275+0000 7f5333fff700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5320067360 0x7f5320069810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f53280091e0 tx=0x7f5328017000 comp rx=0 tx=0).stop 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.275+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 msgr2=0x7f5334166210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.275+0000 7f5333fff700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 0x7f5334166210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f532400c7c0 tx=0x7f5324007e00 comp rx=0 tx=0).stop 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.275+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 shutdown_connections 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.275+0000 7f5333fff700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5320067360 0x7f5320069810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.276+0000 7f5333fff700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53340cc560 0x7f53340b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.276+0000 7f5333fff700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5334069ca0 0x7f5334166210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.276+0000 7f5333fff700 1 --2- 172.21.15.53:0/3567015074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53340add50 0x7f533414e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.276+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 >> 172.21.15.53:0/3567015074 conn(0x7f533406f7f0 msgr2=0x7f53341554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.276+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 shutdown_connections 2023-09-28T00:23:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.276+0000 7f5333fff700 1 -- 172.21.15.53:0/3567015074 wait complete. 2023-09-28T00:23:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2023-09-28T00:23:15.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:15.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.482+0000 7f09ad39d700 1 Processor -- start 2023-09-28T00:23:15.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.482+0000 7f09ad39d700 1 -- start start 2023-09-28T00:23:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09ad39d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09a80add50 0x7f09a81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09ad39d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09a80cc560 0x7f09a80ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09ad39d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a80ccaa0 con 0x7f09a8069ca0 2023-09-28T00:23:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09ad39d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a8068c00 con 0x7f09a80cc560 2023-09-28T00:23:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09ad39d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a8068ee0 con 0x7f09a80add50 2023-09-28T00:23:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09a77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09a80cc560 0x7f09a80ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09a77fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09a80cc560 0x7f09a80ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32910/0 (socket says 172.21.15.53:32910) 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.483+0000 7f09a77fe700 1 -- 172.21.15.53:0/783165684 learned_addr learned my addr 172.21.15.53:0/783165684 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a7fff700 1 --2- 172.21.15.53:0/783165684 >> v2:172.21.15.118:3300/0 conn(0x7f09a80add50 0x7f09a81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a77fe700 1 -- 172.21.15.53:0/783165684 >> v2:172.21.15.118:3300/0 conn(0x7f09a80add50 msgr2=0x7f09a81560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a77fe700 1 --2- 172.21.15.53:0/783165684 >> v2:172.21.15.118:3300/0 conn(0x7f09a80add50 0x7f09a81560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a77fe700 1 -- 172.21.15.53:0/783165684 >> v1:172.21.15.118:6789/0 conn(0x7f09a8069ca0 legacy=0x7f09a814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a77fe700 1 -- 172.21.15.53:0/783165684 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80691c0 con 0x7f09a80cc560 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a77fe700 1 --2- 172.21.15.53:0/783165684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a80ae120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09a8071520 tx=0x7f099c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea69b365d9b643 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a6ffd700 1 -- 172.21.15.53:0/783165684 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c009e70 con 0x7f09a80cc560 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a6ffd700 1 -- 172.21.15.53:0/783165684 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00b8f0 con 0x7f09a80cc560 2023-09-28T00:23:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.484+0000 7f09a6ffd700 1 -- 172.21.15.53:0/783165684 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00bc90 con 0x7f09a80cc560 2023-09-28T00:23:15.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 -- 172.21.15.53:0/783165684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 msgr2=0x7f09a80ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 --2- 172.21.15.53:0/783165684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a80ae120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09a8071520 tx=0x7f099c009250 comp rx=0 tx=0).stop 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 -- 172.21.15.53:0/783165684 shutdown_connections 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 --2- 172.21.15.53:0/783165684 >> v2:172.21.15.118:3300/0 conn(0x7f09a80add50 0x7f09a81560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 --2- 172.21.15.53:0/783165684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a80ae120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 -- 172.21.15.53:0/783165684 >> 172.21.15.53:0/783165684 conn(0x7f09a806f7f0 msgr2=0x7f09a80cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 -- 172.21.15.53:0/783165684 shutdown_connections 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.485+0000 7f09ad39d700 1 -- 172.21.15.53:0/783165684 wait complete. 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.486+0000 7f09ad39d700 1 Processor -- start 2023-09-28T00:23:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.487+0000 7f09ad39d700 1 -- start start 2023-09-28T00:23:15.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.487+0000 7f09ad39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a8069ca0 0x7f09a80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09ad39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a80add50 0x7f09a8151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09ad39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a8151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09ad39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80b1660 con 0x7f09a80cc560 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09ad39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8166280 con 0x7f09a80add50 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09ad39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8166790 con 0x7f09a8069ca0 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a8151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a8151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32914/0 (socket says 172.21.15.53:32914) 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 -- 172.21.15.53:0/3654322092 learned_addr learned my addr 172.21.15.53:0/3654322092 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09a77fe700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a80add50 0x7f09a8151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09a7fff700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a8069ca0 0x7f09a80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 -- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a8069ca0 msgr2=0x7f09a80aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a8069ca0 0x7f09a80aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 -- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a80add50 msgr2=0x7f09a8151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a80add50 0x7f09a8151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 -- 172.21.15.53:0/3654322092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0094f0 con 0x7f09a80cc560 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.488+0000 7f09acb9c700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a8151980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09a000c8e0 tx=0x7f09a0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.489+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0012630 con 0x7f09a80cc560 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.489+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0012790 con 0x7f09a80cc560 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.489+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0012b50 con 0x7f09a80cc560 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.489+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a8152740 con 0x7f09a80cc560 2023-09-28T00:23:15.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.489+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a81529e0 con 0x7f09a80cc560 2023-09-28T00:23:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.490+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a804c3c0 con 0x7f09a80cc560 2023-09-28T00:23:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.491+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f09a001a3a0 con 0x7f09a80cc560 2023-09-28T00:23:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.492+0000 7f098ffff700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0994067330 0x7f09940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.492+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09a0084e30 con 0x7f09a80cc560 2023-09-28T00:23:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.492+0000 7f09a7fff700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0994067330 0x7f09940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.492+0000 7f09a7fff700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0994067330 0x7f09940697e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0998009db0 tx=0x7f09980091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.496+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f09a0055720 con 0x7f09a80cc560 2023-09-28T00:23:15.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.698+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09a8069500 con 0x7f09a80cc560 2023-09-28T00:23:15.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.699+0000 7f098ffff700 1 -- 172.21.15.53:0/3654322092 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f09a00552b0 con 0x7f09a80cc560 2023-09-28T00:23:15.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:15.699 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0994067330 msgr2=0x7f09940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0994067330 0x7f09940697e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0998009db0 tx=0x7f09980091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 msgr2=0x7f09a8151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a8151980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09a000c8e0 tx=0x7f09a0001710 comp rx=0 tx=0).stop 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 shutdown_connections 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0994067330 0x7f09940697e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09a8069ca0 0x7f09a80aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a80cc560 0x7f09a8151980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 --2- 172.21.15.53:0/3654322092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09a80add50 0x7f09a8151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 >> 172.21.15.53:0/3654322092 conn(0x7f09a806f7f0 msgr2=0x7f09a814da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 shutdown_connections 2023-09-28T00:23:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.701+0000 7f09ad39d700 1 -- 172.21.15.53:0/3654322092 wait complete. 2023-09-28T00:23:15.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:22:45.151575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:22:52.312450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-28T00:22:58.139047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-28T00:22:58.662077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-28T00:23:15.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:23:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.911+0000 7f3e08d9d700 1 Processor -- start 2023-09-28T00:23:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.911+0000 7f3e08d9d700 1 -- start start 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e08d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e0415ce00 0x7f3e0415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e08d9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04068230 con 0x7f3e0414d690 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e08d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04153ea0 con 0x7f3e04067630 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e08d9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0406f1e0 con 0x7f3e0415ce00 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e037fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3e0414d690 0x7f3e0406ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41098/0 (socket says 172.21.15.53:41098) 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e037fe700 1 -- 172.21.15.53:0/3733099913 learned_addr learned my addr 172.21.15.53:0/3733099913 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e03fff700 1 --2- 172.21.15.53:0/3733099913 >> v2:172.21.15.53:3300/0 conn(0x7f3e0415ce00 0x7f3e0415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e027fc700 1 -- 172.21.15.53:0/3733099913 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714042739 0 0) 0x7f3e04068230 con 0x7f3e0414d690 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e027fc700 1 -- 172.21.15.53:0/3733099913 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dec003570 con 0x7f3e0414d690 2023-09-28T00:23:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e027fc700 1 -- 172.21.15.53:0/3733099913 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758516102 0 0) 0x7f3e04153ea0 con 0x7f3e04067630 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e03fff700 1 -- 172.21.15.53:0/3733099913 >> v1:172.21.15.118:6789/0 conn(0x7f3e04067630 legacy=0x7f3e040c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e03fff700 1 -- 172.21.15.53:0/3733099913 >> v1:172.21.15.53:6789/0 conn(0x7f3e0414d690 legacy=0x7f3e0406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.913+0000 7f3e03fff700 1 -- 172.21.15.53:0/3733099913 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04154330 con 0x7f3e0415ce00 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.914+0000 7f3e03fff700 1 --2- 172.21.15.53:0/3733099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0415ce00 0x7f3e0415f1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009e60 tx=0x7f3dfc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb73d421750b43a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.914+0000 7f3e027fc700 1 -- 172.21.15.53:0/3733099913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00e070 con 0x7f3e0415ce00 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.914+0000 7f3e027fc700 1 -- 172.21.15.53:0/3733099913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00bb60 con 0x7f3e0415ce00 2023-09-28T00:23:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.914+0000 7f3e027fc700 1 -- 172.21.15.53:0/3733099913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc012430 con 0x7f3e0415ce00 2023-09-28T00:23:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.914+0000 7f3e08d9d700 1 -- 172.21.15.53:0/3733099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0415ce00 msgr2=0x7f3e0415f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.914+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/3733099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0415ce00 0x7f3e0415f1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009e60 tx=0x7f3dfc009780 comp rx=0 tx=0).stop 2023-09-28T00:23:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.915+0000 7f3e08d9d700 1 -- 172.21.15.53:0/3733099913 shutdown_connections 2023-09-28T00:23:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.915+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/3733099913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0415ce00 0x7f3e0415f1e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.915+0000 7f3e08d9d700 1 -- 172.21.15.53:0/3733099913 >> 172.21.15.53:0/3733099913 conn(0x7f3e04068740 msgr2=0x7f3e04068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.915+0000 7f3e08d9d700 1 -- 172.21.15.53:0/3733099913 shutdown_connections 2023-09-28T00:23:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.915+0000 7f3e08d9d700 1 -- 172.21.15.53:0/3733099913 wait complete. 2023-09-28T00:23:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.916+0000 7f3e08d9d700 1 Processor -- start 2023-09-28T00:23:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.916+0000 7f3e08d9d700 1 -- start start 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e08d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 0x7f3e040c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e08d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e0414d690 0x7f3e04152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e08d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e0415ce00 0x7f3e04151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e08d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041447f0 con 0x7f3e04067630 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e08d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041467f0 con 0x7f3e0415ce00 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e08d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04152970 con 0x7f3e0414d690 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 0x7f3e040c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 0x7f3e040c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48078/0 (socket says 172.21.15.53:48078) 2023-09-28T00:23:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e037fe700 1 -- 172.21.15.53:0/557010561 learned_addr learned my addr 172.21.15.53:0/557010561 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.917+0000 7f3e02ffd700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e0414d690 0x7f3e04152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e03fff700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e0415ce00 0x7f3e04151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e037fe700 1 -- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e0414d690 msgr2=0x7f3e04152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e037fe700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e0414d690 0x7f3e04152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e037fe700 1 -- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e0415ce00 msgr2=0x7f3e04151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e037fe700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e0415ce00 0x7f3e04151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e037fe700 1 -- 172.21.15.53:0/557010561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc009a20 con 0x7f3e04067630 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e037fe700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 0x7f3e040c6890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3df40011e0 tx=0x7f3df4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4005b30 con 0x7f3e04067630 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4005c90 con 0x7f3e04067630 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4007300 con 0x7f3e04067630 2023-09-28T00:23:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.918+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e040c8710 con 0x7f3e04067630 2023-09-28T00:23:15.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.919+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e04146230 con 0x7f3e04067630 2023-09-28T00:23:15.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.920+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e04152c50 con 0x7f3e04067630 2023-09-28T00:23:15.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.920+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3df4007670 con 0x7f3e04067630 2023-09-28T00:23:15.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.921+0000 7f3deb7fe700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3df0067330 0x7f3df00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:15.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.921+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3df4084090 con 0x7f3e04067630 2023-09-28T00:23:15.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.922+0000 7f3e02ffd700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3df0067330 0x7f3df00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:15.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.922+0000 7f3e02ffd700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3df0067330 0x7f3df00697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e04141330 tx=0x7f3df8007ec0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:15.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:15.925+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3df4050ef0 con 0x7f3e04067630 2023-09-28T00:23:16.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.130+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e0404c3c0 con 0x7f3e04067630 2023-09-28T00:23:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.130+0000 7f3deb7fe700 1 -- 172.21.15.53:0/557010561 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3df4017020 con 0x7f3e04067630 2023-09-28T00:23:16.130 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3df0067330 msgr2=0x7f3df00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3df0067330 0x7f3df00697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e04141330 tx=0x7f3df8007ec0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 msgr2=0x7f3e040c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 0x7f3e040c6890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3df40011e0 tx=0x7f3df4007df0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 shutdown_connections 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3df0067330 0x7f3df00697e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e0415ce00 0x7f3e04151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04067630 0x7f3e040c6890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 --2- 172.21.15.53:0/557010561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e0414d690 0x7f3e04152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 >> 172.21.15.53:0/557010561 conn(0x7f3e04068740 msgr2=0x7f3e040c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 shutdown_connections 2023-09-28T00:23:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.133+0000 7f3e08d9d700 1 -- 172.21.15.53:0/557010561 wait complete. 2023-09-28T00:23:16.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:23:16.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.339+0000 7f331e79d700 1 Processor -- start 2023-09-28T00:23:16.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.339+0000 7f331e79d700 1 -- start start 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331e79d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33180ad8f0 0x7f331806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331e79d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f33180adcc0 0x7f331806a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331e79d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f331806a940 0x7f331806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331e79d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3318153350 con 0x7f33180ad8f0 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331e79d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33181535c0 con 0x7f33180adcc0 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331e79d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33181538a0 con 0x7f331806a940 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33180ad8f0 0x7f331806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33180ad8f0 0x7f331806b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48084/0 (socket says 172.21.15.53:48084) 2023-09-28T00:23:16.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 -- 172.21.15.53:0/220165216 learned_addr learned my addr 172.21.15.53:0/220165216 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331df9c700 1 --2- 172.21.15.53:0/220165216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f331806a940 0x7f331806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331cf9a700 1 --2- 172.21.15.53:0/220165216 >> v2:172.21.15.118:3300/0 conn(0x7f33180adcc0 0x7f331806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 -- 172.21.15.53:0/220165216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f331806a940 msgr2=0x7f331806ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 --2- 172.21.15.53:0/220165216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f331806a940 0x7f331806ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 -- 172.21.15.53:0/220165216 >> v2:172.21.15.118:3300/0 conn(0x7f33180adcc0 msgr2=0x7f331806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 --2- 172.21.15.53:0/220165216 >> v2:172.21.15.118:3300/0 conn(0x7f33180adcc0 0x7f331806a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331d79b700 1 -- 172.21.15.53:0/220165216 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318153b80 con 0x7f33180ad8f0 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.341+0000 7f331cf9a700 1 --2- 172.21.15.53:0/220165216 >> v2:172.21.15.118:3300/0 conn(0x7f33180adcc0 0x7f331806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.342+0000 7f331d79b700 1 --2- 172.21.15.53:0/220165216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33180ad8f0 0x7f331806b1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3318150db0 tx=0x7f3314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b353a0efa18c27c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.342+0000 7f330ffff700 1 -- 172.21.15.53:0/220165216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314009e70 con 0x7f33180ad8f0 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.342+0000 7f330ffff700 1 -- 172.21.15.53:0/220165216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331400b8f0 con 0x7f33180ad8f0 2023-09-28T00:23:16.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.342+0000 7f330ffff700 1 -- 172.21.15.53:0/220165216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400bc90 con 0x7f33180ad8f0 2023-09-28T00:23:16.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.342+0000 7f331e79d700 1 -- 172.21.15.53:0/220165216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33180ad8f0 msgr2=0x7f331806b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.342+0000 7f331e79d700 1 --2- 172.21.15.53:0/220165216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33180ad8f0 0x7f331806b1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3318150db0 tx=0x7f3314009250 comp rx=0 tx=0).stop 2023-09-28T00:23:16.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 -- 172.21.15.53:0/220165216 shutdown_connections 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 --2- 172.21.15.53:0/220165216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f331806a940 0x7f331806ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 --2- 172.21.15.53:0/220165216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33180ad8f0 0x7f331806b1f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 --2- 172.21.15.53:0/220165216 >> v2:172.21.15.118:3300/0 conn(0x7f33180adcc0 0x7f331806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 -- 172.21.15.53:0/220165216 >> 172.21.15.53:0/220165216 conn(0x7f33180c4c50 msgr2=0x7f33180c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 -- 172.21.15.53:0/220165216 shutdown_connections 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.343+0000 7f331e79d700 1 -- 172.21.15.53:0/220165216 wait complete. 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.344+0000 7f331e79d700 1 Processor -- start 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.344+0000 7f331e79d700 1 -- start start 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331e79d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 0x7f3318167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331e79d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33180ad8f0 0x7f3318164470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331e79d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33180adcc0 0x7f3318141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331e79d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318166bc0 con 0x7f331806a940 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331e79d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180c7820 con 0x7f33180adcc0 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331e79d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180c7b00 con 0x7f33180ad8f0 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331d79b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 0x7f3318167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331d79b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 0x7f3318167050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48090/0 (socket says 172.21.15.53:48090) 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.345+0000 7f331d79b700 1 -- 172.21.15.53:0/794152953 learned_addr learned my addr 172.21.15.53:0/794152953 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331cf9a700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33180ad8f0 0x7f3318164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331df9c700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33180adcc0 0x7f3318141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331d79b700 1 -- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33180ad8f0 msgr2=0x7f3318164470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331d79b700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33180ad8f0 0x7f3318164470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331d79b700 1 -- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33180adcc0 msgr2=0x7f3318141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331d79b700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33180adcc0 0x7f3318141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331d79b700 1 -- 172.21.15.53:0/794152953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140094f0 con 0x7f331806a940 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331cf9a700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33180ad8f0 0x7f3318164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331d79b700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 0x7f3318167050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3314009290 tx=0x7f3314017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400bc70 con 0x7f331806a940 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331401f070 con 0x7f331806a940 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140266d0 con 0x7f331806a940 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.346+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33180c7de0 con 0x7f331806a940 2023-09-28T00:23:16.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.347+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3318166850 con 0x7f331806a940 2023-09-28T00:23:16.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.348+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3318166ea0 con 0x7f331806a940 2023-09-28T00:23:16.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.348+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f331401a430 con 0x7f331806a940 2023-09-28T00:23:16.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.350+0000 7f330d7fa700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f32fc067330 0x7f32fc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.350+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3314021070 con 0x7f331806a940 2023-09-28T00:23:16.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.350+0000 7f331cf9a700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f32fc067330 0x7f32fc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.350+0000 7f331cf9a700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f32fc067330 0x7f32fc0697e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f33180ad6d0 tx=0x7f3308008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.354+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f33140531e0 con 0x7f331806a940 2023-09-28T00:23:16.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.557+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f331804c3c0 con 0x7f331806a940 2023-09-28T00:23:16.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.557+0000 7f330d7fa700 1 -- 172.21.15.53:0/794152953 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3314056800 con 0x7f331806a940 2023-09-28T00:23:16.557 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-09-28T00:23:16.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f32fc067330 msgr2=0x7f32fc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f32fc067330 0x7f32fc0697e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f33180ad6d0 tx=0x7f3308008040 comp rx=0 tx=0).stop 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 msgr2=0x7f3318167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 0x7f3318167050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3314009290 tx=0x7f3314017000 comp rx=0 tx=0).stop 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 shutdown_connections 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f32fc067330 0x7f32fc0697e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33180adcc0 0x7f3318141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f331806a940 0x7f3318167050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 --2- 172.21.15.53:0/794152953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33180ad8f0 0x7f3318164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 >> 172.21.15.53:0/794152953 conn(0x7f33180c4c50 msgr2=0x7f331814ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 shutdown_connections 2023-09-28T00:23:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.559+0000 7f331e79d700 1 -- 172.21.15.53:0/794152953 wait complete. 2023-09-28T00:23:16.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-28T00:23:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.767+0000 7f1b3239d700 1 Processor -- start 2023-09-28T00:23:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.768+0000 7f1b3239d700 1 -- start start 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3239d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b2c0c0e10 0x7f1b2c159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3239d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c11e0 0x7f1b2c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3239d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c156040 con 0x7f1b2c0c16e0 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3239d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c6cf0 con 0x7f1b2c0c0e10 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3239d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c6730 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3139b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b2c0c0e10 0x7f1b2c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3139b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b2c0c0e10 0x7f1b2c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48102/0 (socket says 172.21.15.53:48102) 2023-09-28T00:23:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b31b9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1b2c0c16e0 0x7f1b2c13e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41102/0 (socket says 172.21.15.53:41102) 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b3139b700 1 -- 172.21.15.53:0/1300412464 learned_addr learned my addr 172.21.15.53:0/1300412464 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.769+0000 7f1b30b9a700 1 --2- 172.21.15.53:0/1300412464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c11e0 0x7f1b2c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b3139b700 1 -- 172.21.15.53:0/1300412464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c11e0 msgr2=0x7f1b2c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b3139b700 1 --2- 172.21.15.53:0/1300412464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c11e0 0x7f1b2c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b3139b700 1 -- 172.21.15.53:0/1300412464 >> v1:172.21.15.53:6789/0 conn(0x7f1b2c0c16e0 legacy=0x7f1b2c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b3139b700 1 -- 172.21.15.53:0/1300412464 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0c6a10 con 0x7f1b2c0c0e10 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b23fff700 1 -- 172.21.15.53:0/1300412464 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584705327 0 0) 0x7f1b2c156040 con 0x7f1b2c0c16e0 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b3139b700 1 --2- 172.21.15.53:0/1300412464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c0e10 0x7f1b2c159840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b280099b0 tx=0x7f1b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8af63e06304b3f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b23fff700 1 -- 172.21.15.53:0/1300412464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28009ea0 con 0x7f1b2c0c0e10 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b23fff700 1 -- 172.21.15.53:0/1300412464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2800b860 con 0x7f1b2c0c0e10 2023-09-28T00:23:16.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.770+0000 7f1b23fff700 1 -- 172.21.15.53:0/1300412464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800bc00 con 0x7f1b2c0c0e10 2023-09-28T00:23:16.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 -- 172.21.15.53:0/1300412464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c0e10 msgr2=0x7f1b2c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 --2- 172.21.15.53:0/1300412464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c0e10 0x7f1b2c159840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b280099b0 tx=0x7f1b28009250 comp rx=0 tx=0).stop 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 -- 172.21.15.53:0/1300412464 shutdown_connections 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 --2- 172.21.15.53:0/1300412464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c0e10 0x7f1b2c159840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 --2- 172.21.15.53:0/1300412464 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c11e0 0x7f1b2c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 -- 172.21.15.53:0/1300412464 >> 172.21.15.53:0/1300412464 conn(0x7f1b2c06f830 msgr2=0x7f1b2c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 -- 172.21.15.53:0/1300412464 shutdown_connections 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.771+0000 7f1b3239d700 1 -- 172.21.15.53:0/1300412464 wait complete. 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.772+0000 7f1b3239d700 1 Processor -- start 2023-09-28T00:23:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.772+0000 7f1b3239d700 1 -- start start 2023-09-28T00:23:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b3239d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c0e10 0x7f1b2c1697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b3239d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 0x7f1b2c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b3239d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2c0c16e0 0x7f1b2c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b3239d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c165840 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b3239d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0ca5c0 con 0x7f1b2c0c16e0 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b3239d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c165a30 con 0x7f1b2c0c0e10 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.773+0000 7f1b30b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 0x7f1b2c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 0x7f1b2c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48118/0 (socket says 172.21.15.53:48118) 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 -- 172.21.15.53:0/3297457940 learned_addr learned my addr 172.21.15.53:0/3297457940 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b3139b700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c0e10 0x7f1b2c1697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b31b9c700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2c0c16e0 0x7f1b2c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 -- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c0e10 msgr2=0x7f1b2c1697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c0e10 0x7f1b2c1697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 -- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2c0c16e0 msgr2=0x7f1b2c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2c0c16e0 0x7f1b2c0caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 -- 172.21.15.53:0/3297457940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280094f0 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b31b9c700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2c0c16e0 0x7f1b2c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b30b9a700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 0x7f1b2c0caa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00ec80 tx=0x7f1b1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00c8e0 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c00ca40 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00ce00 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.774+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c165cd0 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.775+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c166290 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.775+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c04c3c0 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.776+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1b1c013680 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.777+0000 7f1b217fa700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b10067330 0x7f1b100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:16.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.777+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b1c084f60 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.778+0000 7f1b3139b700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b10067330 0x7f1b100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:16.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.778+0000 7f1b3139b700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b10067330 0x7f1b100697e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b280099b0 tx=0x7f1b28017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.781+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1b1c051dc0 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.982+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b2c0ca700 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.982+0000 7f1b217fa700 1 -- 172.21.15.53:0/3297457940 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b1c0553e0 con 0x7f1b2c0c11e0 2023-09-28T00:23:16.982 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b10067330 msgr2=0x7f1b100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b10067330 0x7f1b100697e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b280099b0 tx=0x7f1b28017000 comp rx=0 tx=0).stop 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 msgr2=0x7f1b2c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 0x7f1b2c0caa50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00ec80 tx=0x7f1b1c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 shutdown_connections 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1b10067330 0x7f1b100697e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b2c0c0e10 0x7f1b2c1697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2c0c16e0 0x7f1b2c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 --2- 172.21.15.53:0/3297457940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b2c0c11e0 0x7f1b2c0caa50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:16.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 >> 172.21.15.53:0/3297457940 conn(0x7f1b2c06f830 msgr2=0x7f1b2c13c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:16.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 shutdown_connections 2023-09-28T00:23:16.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:16.985+0000 7f1b3239d700 1 -- 172.21.15.53:0/3297457940 wait complete. 2023-09-28T00:23:17.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-28T00:23:17.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.192+0000 7efd4179d700 1 Processor -- start 2023-09-28T00:23:17.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.192+0000 7efd4179d700 1 -- start start 2023-09-28T00:23:17.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd4179d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd3c14bf50 0x7efd3c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd4179d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3c06cc40 con 0x7efd3c156cf0 2023-09-28T00:23:17.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd4179d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3c06bab0 con 0x7efd3c1568c0 2023-09-28T00:23:17.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd4179d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3c063710 con 0x7efd3c14bf50 2023-09-28T00:23:17.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd3bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd3c14bf50 0x7efd3c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd40f9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efd3c156cf0 0x7efd3c068e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41114/0 (socket says 172.21.15.53:41114) 2023-09-28T00:23:17.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.193+0000 7efd40f9c700 1 -- 172.21.15.53:0/1931999637 learned_addr learned my addr 172.21.15.53:0/1931999637 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:17.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3bfff700 1 -- 172.21.15.53:0/1931999637 >> v1:172.21.15.118:6789/0 conn(0x7efd3c1568c0 legacy=0x7efd3c068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3bfff700 1 -- 172.21.15.53:0/1931999637 >> v1:172.21.15.53:6789/0 conn(0x7efd3c156cf0 legacy=0x7efd3c068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3bfff700 1 -- 172.21.15.53:0/1931999637 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c06bd50 con 0x7efd3c14bf50 2023-09-28T00:23:17.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3affd700 1 -- 172.21.15.53:0/1931999637 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122657148 0 0) 0x7efd3c06cc40 con 0x7efd3c156cf0 2023-09-28T00:23:17.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3bfff700 1 --2- 172.21.15.53:0/1931999637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c14bf50 0x7efd3c1553c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0098e0 tx=0x7efd2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9461275c9c0b4e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3affd700 1 -- 172.21.15.53:0/1931999637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c009e80 con 0x7efd3c14bf50 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3affd700 1 -- 172.21.15.53:0/1931999637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c00b8f0 con 0x7efd3c14bf50 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.194+0000 7efd3affd700 1 -- 172.21.15.53:0/1931999637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00bc70 con 0x7efd3c14bf50 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 -- 172.21.15.53:0/1931999637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c14bf50 msgr2=0x7efd3c1553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 --2- 172.21.15.53:0/1931999637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c14bf50 0x7efd3c1553c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0098e0 tx=0x7efd2c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 -- 172.21.15.53:0/1931999637 shutdown_connections 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 --2- 172.21.15.53:0/1931999637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c14bf50 0x7efd3c1553c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 -- 172.21.15.53:0/1931999637 >> 172.21.15.53:0/1931999637 conn(0x7efd3c067630 msgr2=0x7efd3c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:17.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 -- 172.21.15.53:0/1931999637 shutdown_connections 2023-09-28T00:23:17.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.195+0000 7efd4179d700 1 -- 172.21.15.53:0/1931999637 wait complete. 2023-09-28T00:23:17.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.196+0000 7efd4179d700 1 Processor -- start 2023-09-28T00:23:17.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 -- start start 2023-09-28T00:23:17.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 0x7efd3c165e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c1568c0 0x7efd3c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd3c156cf0 0x7efd3c144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c1659a0 con 0x7efd3c1568c0 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c165670 con 0x7efd3c156cf0 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.197+0000 7efd4179d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c169850 con 0x7efd3c14bf50 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd40f9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd3c156cf0 0x7efd3c144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 0x7efd3c165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c1568c0 0x7efd3c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 0x7efd3c165e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:48562/0 (socket says 172.21.15.53:48562) 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 -- 172.21.15.53:0/913462553 learned_addr learned my addr 172.21.15.53:0/913462553 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 -- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd3c156cf0 msgr2=0x7efd3c144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd3c156cf0 0x7efd3c144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 -- 172.21.15.53:0/913462553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c1568c0 msgr2=0x7efd3c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c1568c0 0x7efd3c15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 -- 172.21.15.53:0/913462553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009420 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3b7fe700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c1568c0 0x7efd3c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd40f9c700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd3c156cf0 0x7efd3c144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.198+0000 7efd3bfff700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 0x7efd3c165e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd3c06f0c0 tx=0x7efd2c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.199+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c01f070 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.199+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c00ba60 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.199+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c01a670 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.199+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c0c02d0 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.199+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c0c0890 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.200+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3c04c3c0 con 0x7efd3c14bf50 2023-09-28T00:23:17.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.201+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efd2c01a9e0 con 0x7efd3c14bf50 2023-09-28T00:23:17.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.202+0000 7efd23fff700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efd28067360 0x7efd28069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.202+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd2c086100 con 0x7efd3c14bf50 2023-09-28T00:23:17.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.202+0000 7efd3b7fe700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efd28067360 0x7efd28069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.203+0000 7efd3b7fe700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efd28067360 0x7efd28069810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd3c14a5b0 tx=0x7efd30009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:17.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.206+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efd2c052fe0 con 0x7efd3c14bf50 2023-09-28T00:23:17.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.408+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd3c0c45e0 con 0x7efd3c14bf50 2023-09-28T00:23:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.409+0000 7efd23fff700 1 -- 172.21.15.53:0/913462553 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd2c056600 con 0x7efd3c14bf50 2023-09-28T00:23:17.409 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efd28067360 msgr2=0x7efd28069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efd28067360 0x7efd28069810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd3c14a5b0 tx=0x7efd30009040 comp rx=0 tx=0).stop 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 msgr2=0x7efd3c165e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 0x7efd3c165e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd3c06f0c0 tx=0x7efd2c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 shutdown_connections 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7efd28067360 0x7efd28069810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd3c14bf50 0x7efd3c165e30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd3c156cf0 0x7efd3c144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 --2- 172.21.15.53:0/913462553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c1568c0 0x7efd3c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 >> 172.21.15.53:0/913462553 conn(0x7efd3c067630 msgr2=0x7efd3c147bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:17.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 shutdown_connections 2023-09-28T00:23:17.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.412+0000 7efd4179d700 1 -- 172.21.15.53:0/913462553 wait complete. 2023-09-28T00:23:17.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:23:17.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.616+0000 7f0474d9d700 1 Processor -- start 2023-09-28T00:23:17.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.616+0000 7f0474d9d700 1 -- start start 2023-09-28T00:23:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.617+0000 7f0474d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8bf0 0x7f047006c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.617+0000 7f0474d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f04700c8fc0 0x7f04700c5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f0474d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04700684e0 con 0x7f04700c3e10 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f0474d9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04701553f0 con 0x7f04700c8fc0 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f0474d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04701555e0 con 0x7f04700c8bf0 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f04700c8fc0 0x7f04700c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8bf0 0x7f047006c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046effd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f04700c3e10 0x7f04700c2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:36696/0 (socket says 172.21.15.53:36696) 2023-09-28T00:23:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046effd700 1 -- 172.21.15.53:0/1564410529 learned_addr learned my addr 172.21.15.53:0/1564410529 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046ffff700 1 -- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8bf0 msgr2=0x7f047006c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046ffff700 1 --2- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8bf0 0x7f047006c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046ffff700 1 -- 172.21.15.53:0/1564410529 >> v1:172.21.15.118:6789/0 conn(0x7f04700c3e10 legacy=0x7f04700c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046ffff700 1 -- 172.21.15.53:0/1564410529 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04701558c0 con 0x7f04700c8fc0 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.618+0000 7f046e7fc700 1 -- 172.21.15.53:0/1564410529 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928474534 0 0) 0x7f04700684e0 con 0x7f04700c3e10 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f046ffff700 1 --2- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c8fc0 0x7f04700c5690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0468009e60 tx=0x7f0468009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241509a5b20522a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f046e7fc700 1 -- 172.21.15.53:0/1564410529 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800e070 con 0x7f04700c8fc0 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f046e7fc700 1 -- 172.21.15.53:0/1564410529 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800bbf0 con 0x7f04700c8fc0 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f046e7fc700 1 -- 172.21.15.53:0/1564410529 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468012430 con 0x7f04700c8fc0 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 -- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c8fc0 msgr2=0x7f04700c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 --2- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c8fc0 0x7f04700c5690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0468009e60 tx=0x7f0468009780 comp rx=0 tx=0).stop 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 -- 172.21.15.53:0/1564410529 shutdown_connections 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 --2- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c8fc0 0x7f04700c5690 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 --2- 172.21.15.53:0/1564410529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8bf0 0x7f047006c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 -- 172.21.15.53:0/1564410529 >> 172.21.15.53:0/1564410529 conn(0x7f047006a990 msgr2=0x7f047006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 -- 172.21.15.53:0/1564410529 shutdown_connections 2023-09-28T00:23:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.619+0000 7f0474d9d700 1 -- 172.21.15.53:0/1564410529 wait complete. 2023-09-28T00:23:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.621+0000 7f0474d9d700 1 Processor -- start 2023-09-28T00:23:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.621+0000 7f0474d9d700 1 -- start start 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f0474d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 0x7f047014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f0474d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04700c8bf0 0x7f0470068150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f0474d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8fc0 0x7f0470068690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f0474d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470157a20 con 0x7f04700c8bf0 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f0474d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470157370 con 0x7f04700c3e10 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f0474d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0470158470 con 0x7f04700c8fc0 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04700c8bf0 0x7f0470068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 0x7f047014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 0x7f047014cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:47088/0 (socket says 172.21.15.53:47088) 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04700c8bf0 0x7f0470068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48150/0 (socket says 172.21.15.53:48150) 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 -- 172.21.15.53:0/546092531 learned_addr learned my addr 172.21.15.53:0/546092531 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046ffff700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8fc0 0x7f0470068690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 -- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8fc0 msgr2=0x7f0470068690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8fc0 0x7f0470068690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 -- 172.21.15.53:0/546092531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04700c8bf0 msgr2=0x7f0470068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04700c8bf0 0x7f0470068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.622+0000 7f046f7fe700 1 -- 172.21.15.53:0/546092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0468009a20 con 0x7f04700c3e10 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.623+0000 7f046f7fe700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 0x7f047014cf30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f046000ecb0 tx=0x7f04600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.623+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000c850 con 0x7f04700c3e10 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.623+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000c9b0 con 0x7f04700c3e10 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.623+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000cd50 con 0x7f04700c3e10 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.623+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04700c6f30 con 0x7f04700c3e10 2023-09-28T00:23:17.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.623+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0470156760 con 0x7f04700c3e10 2023-09-28T00:23:17.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.624+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047004c3c0 con 0x7f04700c3e10 2023-09-28T00:23:17.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.625+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0460013680 con 0x7f04700c3e10 2023-09-28T00:23:17.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.626+0000 7f04577fe700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f045c067330 0x7f045c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:17.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.626+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0460084e50 con 0x7f04700c3e10 2023-09-28T00:23:17.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.626+0000 7f046effd700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f045c067330 0x7f045c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:17.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.627+0000 7f046effd700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f045c067330 0x7f045c0697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04700bf800 tx=0x7f0464007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:17.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.631+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0460051cb0 con 0x7f04700c3e10 2023-09-28T00:23:17.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.879+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04700c7830 con 0x7f04700c3e10 2023-09-28T00:23:17.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.880+0000 7f04577fe700 1 -- 172.21.15.53:0/546092531 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6168 (secure 0 0 0) 0x7f04600552d0 con 0x7f04700c3e10 2023-09-28T00:23:17.880 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:17.880 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:22:59.682569+0000","modified":"2023-09-28T00:23:06.715808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4299,"mds_1":4296,"mds_2":4291,"mds_3":4271,"mds_4":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4271":{"gid":4271,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4291":{"gid":4291,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4296":{"gid":4296,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4299":{"gid":4299,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:23:17.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f045c067330 msgr2=0x7f045c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f045c067330 0x7f045c0697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04700bf800 tx=0x7f0464007d30 comp rx=0 tx=0).stop 2023-09-28T00:23:17.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 msgr2=0x7f047014cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 0x7f047014cf30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f046000ecb0 tx=0x7f04600091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 shutdown_connections 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f045c067330 0x7f045c0697e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04700c8fc0 0x7f0470068690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04700c3e10 0x7f047014cf30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 --2- 172.21.15.53:0/546092531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04700c8bf0 0x7f0470068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 >> 172.21.15.53:0/546092531 conn(0x7f047006a990 msgr2=0x7f0470063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 shutdown_connections 2023-09-28T00:23:17.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:17.882+0000 7f0474d9d700 1 -- 172.21.15.53:0/546092531 wait complete. 2023-09-28T00:23:17.884 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2023-09-28T00:23:17.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:18.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.085+0000 7fa71539d700 1 Processor -- start 2023-09-28T00:23:18.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.085+0000 7fa71539d700 1 -- start start 2023-09-28T00:23:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa71539d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa71539d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa710069ca0 0x7fa71006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa71539d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100ccaa0 con 0x7fa7100cc560 2023-09-28T00:23:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa71539d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100ae830 con 0x7fa710069ca0 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa71539d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa710068c00 con 0x7fa7100add50 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa714b9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa710069ca0 0x7fa71006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa70f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa7100cc560 0x7fa7100ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41118/0 (socket says 172.21.15.53:41118) 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.086+0000 7fa70f7fe700 1 -- 172.21.15.53:0/2897319858 learned_addr learned my addr 172.21.15.53:0/2897319858 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa70ffff700 1 --2- 172.21.15.53:0/2897319858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa714b9c700 1 -- 172.21.15.53:0/2897319858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 msgr2=0x7fa7101560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa714b9c700 1 --2- 172.21.15.53:0/2897319858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa714b9c700 1 -- 172.21.15.53:0/2897319858 >> v1:172.21.15.53:6789/0 conn(0x7fa7100cc560 legacy=0x7fa7100ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa714b9c700 1 -- 172.21.15.53:0/2897319858 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710068ee0 con 0x7fa710069ca0 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa70effd700 1 -- 172.21.15.53:0/2897319858 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498265349 0 0) 0x7fa7100ccaa0 con 0x7fa7100cc560 2023-09-28T00:23:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa714b9c700 1 --2- 172.21.15.53:0/2897319858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa710069ca0 0x7fa71006a100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa708009e60 tx=0x7fa708009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e893af24cd5e50b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:18.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.087+0000 7fa70effd700 1 -- 172.21.15.53:0/2897319858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800e070 con 0x7fa710069ca0 2023-09-28T00:23:18.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa70effd700 1 -- 172.21.15.53:0/2897319858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70800bbf0 con 0x7fa710069ca0 2023-09-28T00:23:18.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa70effd700 1 -- 172.21.15.53:0/2897319858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708012430 con 0x7fa710069ca0 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 -- 172.21.15.53:0/2897319858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa710069ca0 msgr2=0x7fa71006a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 --2- 172.21.15.53:0/2897319858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa710069ca0 0x7fa71006a100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa708009e60 tx=0x7fa708009780 comp rx=0 tx=0).stop 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 -- 172.21.15.53:0/2897319858 shutdown_connections 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 --2- 172.21.15.53:0/2897319858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa710069ca0 0x7fa71006a100 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 --2- 172.21.15.53:0/2897319858 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 -- 172.21.15.53:0/2897319858 >> 172.21.15.53:0/2897319858 conn(0x7fa71006f7f0 msgr2=0x7fa7100cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 -- 172.21.15.53:0/2897319858 shutdown_connections 2023-09-28T00:23:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.088+0000 7fa71539d700 1 -- 172.21.15.53:0/2897319858 wait complete. 2023-09-28T00:23:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.090+0000 7fa71539d700 1 Processor -- start 2023-09-28T00:23:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.090+0000 7fa71539d700 1 -- start start 2023-09-28T00:23:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa71539d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa710069ca0 0x7fa7101655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa71539d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa71539d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 0x7fa71014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa71539d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710157f70 con 0x7fa7100cc560 2023-09-28T00:23:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa71539d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710158780 con 0x7fa710069ca0 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa71539d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b15b0 con 0x7fa7100add50 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 0x7fa71014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa710069ca0 0x7fa7101655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 0x7fa71014b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48162/0 (socket says 172.21.15.53:48162) 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 -- 172.21.15.53:0/3094324501 learned_addr learned my addr 172.21.15.53:0/3094324501 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa70f7fe700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 -- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 msgr2=0x7fa7101514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 -- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa710069ca0 msgr2=0x7fa7101655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa710069ca0 0x7fa7101655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.091+0000 7fa714b9c700 1 -- 172.21.15.53:0/3094324501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708009a20 con 0x7fa7100cc560 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.092+0000 7fa714b9c700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 0x7fa71014b070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa708012ad0 tx=0x7fa708019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.092+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708027470 con 0x7fa7100cc560 2023-09-28T00:23:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.092+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080275d0 con 0x7fa7100cc560 2023-09-28T00:23:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.092+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708027990 con 0x7fa7100cc560 2023-09-28T00:23:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.092+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7101581c0 con 0x7fa7100cc560 2023-09-28T00:23:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.092+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100b0f60 con 0x7fa7100cc560 2023-09-28T00:23:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.093+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100b1740 con 0x7fa7100cc560 2023-09-28T00:23:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.094+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa708024070 con 0x7fa7100cc560 2023-09-28T00:23:18.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.095+0000 7fa6f7fff700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa6fc067330 0x7fa6fc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.096+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa708086d20 con 0x7fa7100cc560 2023-09-28T00:23:18.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.096+0000 7fa70ffff700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa6fc067330 0x7fa6fc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.096+0000 7fa70ffff700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa6fc067330 0x7fa6fc0697e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa700009db0 tx=0x7fa7000091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.100+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa708053b80 con 0x7fa7100cc560 2023-09-28T00:23:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.302+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa71004c3c0 con 0x7fa7100cc560 2023-09-28T00:23:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.303+0000 7fa6f7fff700 1 -- 172.21.15.53:0/3094324501 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fa7080571a0 con 0x7fa7100cc560 2023-09-28T00:23:18.303 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:18.303 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.305+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa6fc067330 msgr2=0x7fa6fc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.305+0000 7fa71539d700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa6fc067330 0x7fa6fc0697e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa700009db0 tx=0x7fa7000091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.305+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 msgr2=0x7fa71014b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.305+0000 7fa71539d700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 0x7fa71014b070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa708012ad0 tx=0x7fa708019000 comp rx=0 tx=0).stop 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 shutdown_connections 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa6fc067330 0x7fa6fc0697e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7100cc560 0x7fa71014b070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa710069ca0 0x7fa7101655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 --2- 172.21.15.53:0/3094324501 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7100add50 0x7fa7101514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 >> 172.21.15.53:0/3094324501 conn(0x7fa71006f7f0 msgr2=0x7fa7100ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:18.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 shutdown_connections 2023-09-28T00:23:18.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.306+0000 7fa71539d700 1 -- 172.21.15.53:0/3094324501 wait complete. 2023-09-28T00:23:18.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:23:18.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.511+0000 7f5adb39d700 1 Processor -- start 2023-09-28T00:23:18.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.511+0000 7f5adb39d700 1 -- start start 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5adb39d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ad40add50 0x7f5ad41560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5adb39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad40ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5adb39d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40ccaa0 con 0x7f5ad4069ca0 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5adb39d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad4068c00 con 0x7f5ad40add50 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5adb39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad4068ee0 con 0x7f5ad40cc560 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5ada39b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ad40add50 0x7f5ad41560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5ada39b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ad40add50 0x7f5ad41560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48176/0 (socket says 172.21.15.53:48176) 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ada39b700 1 -- 172.21.15.53:0/1629684429 learned_addr learned my addr 172.21.15.53:0/1629684429 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.512+0000 7f5adab9c700 1 --1- 172.21.15.53:0/1629684429 >> v1:172.21.15.53:6789/0 conn(0x7f5ad4069ca0 0x7f5ad414f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41132/0 (socket says 172.21.15.53:41132) 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ad9b9a700 1 --2- 172.21.15.53:0/1629684429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad40ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ada39b700 1 -- 172.21.15.53:0/1629684429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 msgr2=0x7f5ad40ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ada39b700 1 --2- 172.21.15.53:0/1629684429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad40ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ada39b700 1 -- 172.21.15.53:0/1629684429 >> v1:172.21.15.53:6789/0 conn(0x7f5ad4069ca0 legacy=0x7f5ad414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ada39b700 1 -- 172.21.15.53:0/1629684429 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40691c0 con 0x7f5ad40add50 2023-09-28T00:23:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ada39b700 1 --2- 172.21.15.53:0/1629684429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad41560f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00099b0 tx=0x7f5ad0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2c4d64ee6bdf7b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ad9399700 1 -- 172.21.15.53:0/1629684429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0009ea0 con 0x7f5ad40add50 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ad9399700 1 -- 172.21.15.53:0/1629684429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000b8f0 con 0x7f5ad40add50 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.513+0000 7f5ad9399700 1 -- 172.21.15.53:0/1629684429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000bc90 con 0x7f5ad40add50 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 -- 172.21.15.53:0/1629684429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 msgr2=0x7f5ad41560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 --2- 172.21.15.53:0/1629684429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad41560f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00099b0 tx=0x7f5ad0009250 comp rx=0 tx=0).stop 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 -- 172.21.15.53:0/1629684429 shutdown_connections 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 --2- 172.21.15.53:0/1629684429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad41560f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 --2- 172.21.15.53:0/1629684429 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad40ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 -- 172.21.15.53:0/1629684429 >> 172.21.15.53:0/1629684429 conn(0x7f5ad406f7f0 msgr2=0x7f5ad40cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 -- 172.21.15.53:0/1629684429 shutdown_connections 2023-09-28T00:23:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.514+0000 7f5adb39d700 1 -- 172.21.15.53:0/1629684429 wait complete. 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.516+0000 7f5adb39d700 1 Processor -- start 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.516+0000 7f5adb39d700 1 -- start start 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adb39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad4069ca0 0x7f5ad41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adb39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad4157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adb39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad4158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adb39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad4156840 con 0x7f5ad40add50 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adb39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41573c0 con 0x7f5ad4069ca0 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adb39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad4166bb0 con 0x7f5ad40cc560 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad4157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ada39b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad4069ca0 0x7f5ad41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad4157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48184/0 (socket says 172.21.15.53:48184) 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 -- 172.21.15.53:0/3734721483 learned_addr learned my addr 172.21.15.53:0/3734721483 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adab9c700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad4158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 -- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 msgr2=0x7f5ad4158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad4158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 -- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad4069ca0 msgr2=0x7f5ad41522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad4069ca0 0x7f5ad41522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5ad9b9a700 1 -- 172.21.15.53:0/3734721483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00094f0 con 0x7f5ad40add50 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.517+0000 7f5adab9c700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad4158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.518+0000 7f5ad9b9a700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad4157f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400e930 tx=0x7f5ac40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.518+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4013680 con 0x7f5ad40add50 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.518+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac40137e0 con 0x7f5ad40add50 2023-09-28T00:23:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.518+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4013ba0 con 0x7f5ad40add50 2023-09-28T00:23:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.518+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad4156a90 con 0x7f5ad40add50 2023-09-28T00:23:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.518+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad4157050 con 0x7f5ad40add50 2023-09-28T00:23:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.519+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad4157530 con 0x7f5ad40add50 2023-09-28T00:23:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.520+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5ac400c460 con 0x7f5ad40add50 2023-09-28T00:23:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.521+0000 7f5aca7fc700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ab8067330 0x7f5ab80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.521+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ac4084d10 con 0x7f5ad40add50 2023-09-28T00:23:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.521+0000 7f5ada39b700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ab8067330 0x7f5ab80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.522+0000 7f5ada39b700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ab8067330 0x7f5ab80697e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00099b0 tx=0x7f5ad0017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:18.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.525+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5ac408a020 con 0x7f5ad40add50 2023-09-28T00:23:18.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.772+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ad404c3c0 con 0x7f5ad40add50 2023-09-28T00:23:18.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.773+0000 7f5aca7fc700 1 -- 172.21.15.53:0/3734721483 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6168 (secure 0 0 0) 0x7f5ac4051b70 con 0x7f5ad40add50 2023-09-28T00:23:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:18.773 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:22:59.682569+0000","modified":"2023-09-28T00:23:06.715808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4299,"mds_1":4296,"mds_2":4291,"mds_3":4271,"mds_4":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4271":{"gid":4271,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4291":{"gid":4291,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4296":{"gid":4296,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4299":{"gid":4299,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ab8067330 msgr2=0x7f5ab80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ab8067330 0x7f5ab80697e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00099b0 tx=0x7f5ad0017000 comp rx=0 tx=0).stop 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 msgr2=0x7f5ad4157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad4157f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400e930 tx=0x7f5ac40091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 shutdown_connections 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ab8067330 0x7f5ab80697e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ad40cc560 0x7f5ad4158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ad4069ca0 0x7f5ad41522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 --2- 172.21.15.53:0/3734721483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40add50 0x7f5ad4157f40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:18.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 >> 172.21.15.53:0/3734721483 conn(0x7f5ad406f7f0 msgr2=0x7f5ad414f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:18.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.775+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 shutdown_connections 2023-09-28T00:23:18.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:18.776+0000 7f5adb39d700 1 -- 172.21.15.53:0/3734721483 wait complete. 2023-09-28T00:23:18.777 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2023-09-28T00:23:19.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-28T00:22:59.682569+0000', 'modified': '2023-09-28T00:23:06.715808+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4299, 'mds_1': 4296, 'mds_2': 4291, 'mds_3': 4271, 'mds_4': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'b', 'rank': 4, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.118:6836/444893830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 444893830}, {'type': 'v1', 'addr': '172.21.15.118:6836', 'nonce': 444893830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4271': {'gid': 4271, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.118:6839/853666591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 853666591}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 853666591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4291': {'gid': 4291, 'name': 'e', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.53:6837/3451016827', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6835', 'nonce': 3451016827}, {'type': 'v1', 'addr': '172.21.15.53:6837', 'nonce': 3451016827}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.53:6833/2321695931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6832', 'nonce': 2321695931}, {'type': 'v1', 'addr': '172.21.15.53:6833', 'nonce': 2321695931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4299': {'gid': 4299, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6836/4226289239', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 4226289239}, {'type': 'v1', 'addr': '172.21.15.53:6836', 'nonce': 4226289239}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-28T00:23:19.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-09-28T00:23:19.397 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-28T00:23:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.596+0000 7fd07cf9d700 1 Processor -- start 2023-09-28T00:23:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.596+0000 7fd07cf9d700 1 -- start start 2023-09-28T00:23:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.597+0000 7fd07cf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c1110 0x7fd0781573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.597+0000 7fd07cf9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0780c4550 0x7fd07814d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.597+0000 7fd07cf9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd078153460 con 0x7fd0780c14e0 2023-09-28T00:23:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.597+0000 7fd07cf9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd078153700 con 0x7fd0780c4550 2023-09-28T00:23:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd07cf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781539e0 con 0x7fd0780c1110 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0780c4550 0x7fd07814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0780c4550 0x7fd07814d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48196/0 (socket says 172.21.15.53:48196) 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 -- 172.21.15.53:0/2453900972 learned_addr learned my addr 172.21.15.53:0/2453900972 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd0777fe700 1 --2- 172.21.15.53:0/2453900972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c1110 0x7fd0781573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd076ffd700 1 --1- 172.21.15.53:0/2453900972 >> v1:172.21.15.118:6789/0 conn(0x7fd0780c14e0 0x7fd0780c3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:36704/0 (socket says 172.21.15.53:36704) 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 -- 172.21.15.53:0/2453900972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c1110 msgr2=0x7fd0781573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 --2- 172.21.15.53:0/2453900972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c1110 0x7fd0781573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 -- 172.21.15.53:0/2453900972 >> v1:172.21.15.118:6789/0 conn(0x7fd0780c14e0 legacy=0x7fd0780c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 -- 172.21.15.53:0/2453900972 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078153cc0 con 0x7fd0780c4550 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd0767fc700 1 -- 172.21.15.53:0/2453900972 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971041891 0 0) 0x7fd078153460 con 0x7fd0780c14e0 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.598+0000 7fd077fff700 1 --2- 172.21.15.53:0/2453900972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c4550 0x7fd07814d170 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd070009f20 tx=0x7fd070009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb1720656db7bf server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd0767fc700 1 -- 172.21.15.53:0/2453900972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e070 con 0x7fd0780c4550 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd0767fc700 1 -- 172.21.15.53:0/2453900972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000ba60 con 0x7fd0780c4550 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd0767fc700 1 -- 172.21.15.53:0/2453900972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0700092e0 con 0x7fd0780c4550 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 -- 172.21.15.53:0/2453900972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c4550 msgr2=0x7fd07814d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/2453900972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c4550 0x7fd07814d170 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd070009f20 tx=0x7fd070009840 comp rx=0 tx=0).stop 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 -- 172.21.15.53:0/2453900972 shutdown_connections 2023-09-28T00:23:19.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/2453900972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c4550 0x7fd07814d170 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/2453900972 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c1110 0x7fd0781573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 -- 172.21.15.53:0/2453900972 >> 172.21.15.53:0/2453900972 conn(0x7fd07806b5d0 msgr2=0x7fd07806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 -- 172.21.15.53:0/2453900972 shutdown_connections 2023-09-28T00:23:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.599+0000 7fd07cf9d700 1 -- 172.21.15.53:0/2453900972 wait complete. 2023-09-28T00:23:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.601+0000 7fd07cf9d700 1 Processor -- start 2023-09-28T00:23:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.601+0000 7fd07cf9d700 1 -- start start 2023-09-28T00:23:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd07cf9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0780c1110 0x7fd078167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd07cf9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 0x7fd078163990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd07cf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c4550 0x7fd0780bd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd07cf9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07814c390 con 0x7fd0780c14e0 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd07cf9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07814fb40 con 0x7fd0780c1110 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd07cf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd078163500 con 0x7fd0780c4550 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd076ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 0x7fd078163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0780c1110 0x7fd078167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd076ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 0x7fd078163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48210/0 (socket says 172.21.15.53:48210) 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd076ffd700 1 -- 172.21.15.53:0/1058881360 learned_addr learned my addr 172.21.15.53:0/1058881360 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.602+0000 7fd077fff700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c4550 0x7fd0780bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd0777fe700 1 -- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c4550 msgr2=0x7fd0780bd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd0777fe700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c4550 0x7fd0780bd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd0777fe700 1 -- 172.21.15.53:0/1058881360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 msgr2=0x7fd078163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd0777fe700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 0x7fd078163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd0777fe700 1 -- 172.21.15.53:0/1058881360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070009ae0 con 0x7fd0780c1110 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd077fff700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c4550 0x7fd0780bd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd076ffd700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 0x7fd078163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd0777fe700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0780c1110 0x7fd078167050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ea50 tx=0x7fd0680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd05f7fe700 1 -- 172.21.15.53:0/1058881360 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800ee90 con 0x7fd0780c1110 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd05f7fe700 1 -- 172.21.15.53:0/1058881360 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06800c7f0 con 0x7fd0780c1110 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd05f7fe700 1 -- 172.21.15.53:0/1058881360 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800cb90 con 0x7fd0780c1110 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0781506a0 con 0x7fd0780c1110 2023-09-28T00:23:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.603+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078150050 con 0x7fd0780c1110 2023-09-28T00:23:19.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.605+0000 7fd05f7fe700 1 -- 172.21.15.53:0/1058881360 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd068013470 con 0x7fd0780c1110 2023-09-28T00:23:19.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.607+0000 7fd05f7fe700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd064067360 0x7fd064069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.607+0000 7fd05f7fe700 1 -- 172.21.15.53:0/1058881360 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd068084d90 con 0x7fd0780c1110 2023-09-28T00:23:19.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.607+0000 7fd076ffd700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd064067360 0x7fd064069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.608+0000 7fd076ffd700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd064067360 0x7fd064069810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd078167590 tx=0x7fd06c007e10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.608+0000 7fd08c986b80 1 Processor -- start 2023-09-28T00:23:19.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 -- start start 2023-09-28T00:23:19.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d11889e60 0x561d118d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d117e2a70 con 0x561d118d1bb0 2023-09-28T00:23:19.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d117e0270 con 0x561d118cd1e0 2023-09-28T00:23:19.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.609+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d117dc060 con 0x561d11889e60 2023-09-28T00:23:19.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd076ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d11889e60 0x561d118d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:47126/0 (socket says 172.21.15.53:47126) 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd076ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d11889e60 0x561d118d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:48654/0 (socket says 172.21.15.53:48654) 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48214/0 (socket says 172.21.15.53:48214) 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd0777fe700 1 -- 172.21.15.53:0/929877278 learned_addr learned my addr 172.21.15.53:0/929877278 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 -- 172.21.15.53:0/929877278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d11889e60 msgr2=0x561d118d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d11889e60 0x561d118d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 -- 172.21.15.53:0/929877278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 msgr2=0x561d118ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 -- 172.21.15.53:0/929877278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d11676270 con 0x561d118d1bb0 2023-09-28T00:23:19.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd077fff700 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118c72d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd070015000 tx=0x7fd070018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a852eb4f166ce3c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd05d7fa700 1 -- 172.21.15.53:0/929877278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070007200 con 0x561d118d1bb0 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd05d7fa700 1 -- 172.21.15.53:0/929877278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000bbd0 con 0x561d118d1bb0 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.610+0000 7fd05d7fa700 1 -- 172.21.15.53:0/929877278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070007610 con 0x561d118d1bb0 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 -- 172.21.15.53:0/929877278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 msgr2=0x561d118c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118c72d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd070015000 tx=0x7fd070018000 comp rx=0 tx=0).stop 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 -- 172.21.15.53:0/929877278 shutdown_connections 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118c72d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 --2- 172.21.15.53:0/929877278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d11889e60 0x561d118d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 -- 172.21.15.53:0/929877278 >> 172.21.15.53:0/929877278 conn(0x561d1188b260 msgr2=0x561d1188b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 -- 172.21.15.53:0/929877278 shutdown_connections 2023-09-28T00:23:19.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.611+0000 7fd08c986b80 1 -- 172.21.15.53:0/929877278 wait complete. 2023-09-28T00:23:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.612+0000 7fd08c986b80 1 -- start start 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.612+0000 7fd08c986b80 1 Processor -- start 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118cd1e0 0x561d118c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118e1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d11787890 con 0x561d118d1bb0 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d117a2ea0 con 0x561d11889e60 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d1165ee30 con 0x561d118cd1e0 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd08c986b80 10 client.0 _ll_register_callbacks cb 0x561d1184f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:19.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd077fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd077fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118e1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48222/0 (socket says 172.21.15.53:48222) 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd077fff700 1 -- 172.21.15.53:0/3102217481 learned_addr learned my addr 172.21.15.53:0/3102217481 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd0777fe700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.613+0000 7fd076ffd700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118cd1e0 0x561d118c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd077fff700 1 -- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118cd1e0 msgr2=0x561d118c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd077fff700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118cd1e0 0x561d118c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd077fff700 1 -- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 msgr2=0x561d118d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd077fff700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd077fff700 1 -- 172.21.15.53:0/3102217481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078153cc0 con 0x561d118d1bb0 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd077fff700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118e1420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd070007cf0 tx=0x7fd070020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb66e34c32115b91 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd055ffb700 1 -- 172.21.15.53:0/3102217481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070009940 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd055ffb700 1 -- 172.21.15.53:0/3102217481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd070027690 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d11880940 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd055ffb700 1 -- 172.21.15.53:0/3102217481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd070027a60 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd08c986b80 10 client.4698 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.614+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561d11618fe0 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd055ffb700 1 -- 172.21.15.53:0/3102217481 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d11880940 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd055ffb700 1 -- 172.21.15.53:0/3102217481 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7fd070019070 con 0x561d118d1bb0 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd08c986b80 10 client.4698 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd08c986b80 10 client.4698 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-28T00:23:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd08c986b80 20 client.4698 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118bd140 0x561d118bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd08c986b80 4 client.4698 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T00:23:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 --> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d1185d870 con 0x561d118bd140 2023-09-28T00:23:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.615+0000 7fd0777fe700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118bd140 0x561d118bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.616+0000 7fd055ffb700 10 client.4698 ms_handle_connect on v2:172.21.15.118:6834/444893830 2023-09-28T00:23:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.616+0000 7fd0777fe700 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118bd140 0x561d118bd510 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=73314cdb069606b5 server_cookie=7ba9b808183d530d in_seq=0 out_seq=0 2023-09-28T00:23:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.616+0000 7fd055ffb700 1 -- 172.21.15.53:0/3102217481 <== mds.4 v2:172.21.15.118:6834/444893830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561d1185d870 con 0x561d118bd140 2023-09-28T00:23:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.616+0000 7fd055ffb700 10 client.4698 handle_command_reply: tid=0 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.616+0000 7fd08c986b80 1 client.4698 shutdown 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 msgr2=0x561d118e1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118e1420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd070007cf0 tx=0x7fd070020040 comp rx=0 tx=0).stop 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 shutdown_connections 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118bd140 0x561d118bd510 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118d1bb0 0x561d118e1420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3102217481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118cd1e0 0x561d118c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 >> 172.21.15.53:0/3102217481 conn(0x561d1188b260 msgr2=0x561d118cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd055ffb700 0 client.4698 ms_handle_reset on v2:172.21.15.118:6834/444893830 2023-09-28T00:23:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 shutdown_connections 2023-09-28T00:23:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 1 -- 172.21.15.53:0/3102217481 wait complete. 2023-09-28T00:23:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.617+0000 7fd08c986b80 20 client.4698 trim_cache size 0 max 16384 2023-09-28T00:23:19.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.635+0000 7fd08c986b80 1 Processor -- start 2023-09-28T00:23:19.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.635+0000 7fd08c986b80 1 -- start start 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.635+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118cd1e0 0x561d118c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d1188cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd08c986b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d118c26b0 con 0x561d118cd1e0 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d1188e170 con 0x561d11889e60 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d118888e0 con 0x561d118d1bb0 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118cd1e0 0x561d118c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:47152/0 (socket says 172.21.15.53:47152) 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd0777fe700 1 -- 172.21.15.53:0/2588204831 learned_addr learned my addr 172.21.15.53:0/2588204831 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd077fff700 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d1188cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 -- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 msgr2=0x561d1188cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d1188cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 -- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 msgr2=0x561d118d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 -- 172.21.15.53:0/2588204831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d117aa780 con 0x561d118cd1e0 2023-09-28T00:23:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.636+0000 7fd076ffd700 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118cd1e0 0x561d118c5dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0018c0 tx=0x7fd06c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d2959f5973a096 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd05dffb700 1 -- 172.21.15.53:0/2588204831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c013a60 con 0x561d118cd1e0 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd05dffb700 1 -- 172.21.15.53:0/2588204831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c026070 con 0x561d118cd1e0 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd05dffb700 1 -- 172.21.15.53:0/2588204831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06c013e10 con 0x561d118cd1e0 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 -- 172.21.15.53:0/2588204831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118cd1e0 msgr2=0x561d118c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118cd1e0 0x561d118c5dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0018c0 tx=0x7fd06c014000 comp rx=0 tx=0).stop 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 -- 172.21.15.53:0/2588204831 shutdown_connections 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d1188cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d11889e60 0x561d118d1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 --2- 172.21.15.53:0/2588204831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d118cd1e0 0x561d118c5dc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 -- 172.21.15.53:0/2588204831 >> 172.21.15.53:0/2588204831 conn(0x561d1188b260 msgr2=0x561d1188b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 -- 172.21.15.53:0/2588204831 shutdown_connections 2023-09-28T00:23:19.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.637+0000 7fd08c986b80 1 -- 172.21.15.53:0/2588204831 wait complete. 2023-09-28T00:23:19.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.638+0000 7fd08c986b80 1 -- start start 2023-09-28T00:23:19.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.638+0000 7fd08c986b80 1 Processor -- start 2023-09-28T00:23:19.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 0x561d118ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d11931260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d118c12d0 con 0x561d11889e60 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d118bad70 con 0x561d118cd1e0 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d119375c0 con 0x561d118d1bb0 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd08c986b80 10 client.0 _ll_register_callbacks cb 0x561d1184f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:19.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 0x561d118ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 0x561d118ba3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48238/0 (socket says 172.21.15.53:48238) 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.639+0000 7fd0777fe700 1 -- 172.21.15.53:0/3652578895 learned_addr learned my addr 172.21.15.53:0/3652578895 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd076ffd700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd077fff700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d11931260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd0777fe700 1 -- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 msgr2=0x561d11931260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd0777fe700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d11931260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd0777fe700 1 -- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 msgr2=0x561d118b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd0777fe700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd0777fe700 1 -- 172.21.15.53:0/3652578895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c007590 con 0x561d11889e60 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd077fff700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d11931260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd0777fe700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 0x561d118ba3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ea20 tx=0x7fd068015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179f5cbce085df84 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd055ffb700 1 -- 172.21.15.53:0/3652578895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068055b10 con 0x561d11889e60 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd055ffb700 1 -- 172.21.15.53:0/3652578895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd068055c70 con 0x561d11889e60 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd07000bbd0 con 0x561d11889e60 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd055ffb700 1 -- 172.21.15.53:0/3652578895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd068054fb0 con 0x561d11889e60 2023-09-28T00:23:19.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd08c986b80 10 client.4704 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561d11791470 con 0x561d11889e60 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.640+0000 7fd055ffb700 1 -- 172.21.15.53:0/3652578895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd068065080 con 0x561d11889e60 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd055ffb700 1 -- 172.21.15.53:0/3652578895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7fd06805c3c0 con 0x561d11889e60 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd08c986b80 10 client.4704 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd08c986b80 10 client.4704 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd08c986b80 20 client.4704 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118c6e30 0x561d118c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd08c986b80 4 client.4704 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2023-09-28T00:23:19.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 --> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d1177ee00 con 0x561d118c6e30 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.641+0000 7fd076ffd700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118c6e30 0x561d118c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd055ffb700 10 client.4704 ms_handle_connect on v2:172.21.15.118:6834/444893830 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd076ffd700 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118c6e30 0x561d118c7200 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b9ac2be5c63e2e21 server_cookie=46bc849c6a5bb9e5 in_seq=0 out_seq=0 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd055ffb700 1 -- 172.21.15.53:0/3652578895 <== mds.4 v2:172.21.15.118:6834/444893830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x561d1177ee00 con 0x561d118c6e30 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd055ffb700 10 client.4704 handle_command_reply: tid=0 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 client.4704 shutdown 2023-09-28T00:23:19.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 msgr2=0x561d118ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 0x561d118ba3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ea20 tx=0x7fd068015040 comp rx=0 tx=0).stop 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 shutdown_connections 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:6834/444893830,v1:172.21.15.118:6836/444893830] conn(0x561d118c6e30 0x561d118c7200 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x561d118d1bb0 0x561d11931260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d11889e60 0x561d118ba3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 --2- 172.21.15.53:0/3652578895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d118cd1e0 0x561d118b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd055ffb700 0 client.4704 ms_handle_reset on v2:172.21.15.118:6834/444893830 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 >> 172.21.15.53:0/3652578895 conn(0x561d1188b260 msgr2=0x561d118d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 shutdown_connections 2023-09-28T00:23:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 1 -- 172.21.15.53:0/3652578895 wait complete. 2023-09-28T00:23:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.642+0000 7fd08c986b80 20 client.4704 trim_cache size 0 max 16384 2023-09-28T00:23:19.653 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:19.653 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "95448d9d-c293-4b2c-9850-98d8a7632343", 2023-09-28T00:23:19.653 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 4, 2023-09-28T00:23:19.653 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4270, 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 13.927146421, 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 16, 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 25, 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 25, 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 25.352342601 2023-09-28T00:23:19.654 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd064067360 msgr2=0x7fd064069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd064067360 0x7fd064069810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd078167590 tx=0x7fd06c007e10 comp rx=0 tx=0).stop 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0780c1110 msgr2=0x7fd078167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0780c1110 0x7fd078167050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ea50 tx=0x7fd0680091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 shutdown_connections 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fd064067360 0x7fd064069810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0780c4550 0x7fd0780bd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0780c1110 0x7fd078167050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 --2- 172.21.15.53:0/1058881360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0780c14e0 0x7fd078163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 >> 172.21.15.53:0/1058881360 conn(0x7fd07806b5d0 msgr2=0x7fd0780c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 shutdown_connections 2023-09-28T00:23:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.643+0000 7fd07cf9d700 1 -- 172.21.15.53:0/1058881360 wait complete. 2023-09-28T00:23:19.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-09-28T00:23:19.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.858+0000 7f6b8559d700 1 Processor -- start 2023-09-28T00:23:19.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.858+0000 7f6b8559d700 1 -- start start 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b8559d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b800c0990 0x7f6b800bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b8559d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b8014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b8559d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b80156a00 con 0x7f6b800c4fe0 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b8559d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b80156560 con 0x7f6b800c0990 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b8559d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800bf260 con 0x7f6b800c0d60 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b800c0990 0x7f6b800bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b800c0990 0x7f6b800bed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48248/0 (socket says 172.21.15.53:48248) 2023-09-28T00:23:19.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7f7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b800c4fe0 0x7f6b80152ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41138/0 (socket says 172.21.15.53:41138) 2023-09-28T00:23:19.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7ffff700 1 -- 172.21.15.53:0/912353461 learned_addr learned my addr 172.21.15.53:0/912353461 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/912353461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b8014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7ffff700 1 -- 172.21.15.53:0/912353461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 msgr2=0x7f6b8014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/912353461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b8014bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7ffff700 1 -- 172.21.15.53:0/912353461 >> v1:172.21.15.53:6789/0 conn(0x7f6b800c4fe0 legacy=0x7f6b80152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.861+0000 7f6b7ffff700 1 -- 172.21.15.53:0/912353461 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80152a10 con 0x7f6b800c0990 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.860+0000 7f6b7effd700 1 -- 172.21.15.53:0/912353461 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907711449 0 0) 0x7f6b80156a00 con 0x7f6b800c4fe0 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.861+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/912353461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b800bed20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b700099e0 tx=0x7f6b70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158827b165aba58c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.861+0000 7f6b7effd700 1 -- 172.21.15.53:0/912353461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000b820 con 0x7f6b800c0990 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.861+0000 7f6b7effd700 1 -- 172.21.15.53:0/912353461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000b980 con 0x7f6b800c0990 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.861+0000 7f6b7effd700 1 -- 172.21.15.53:0/912353461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000bd20 con 0x7f6b800c0990 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 -- 172.21.15.53:0/912353461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 msgr2=0x7f6b800bed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 --2- 172.21.15.53:0/912353461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b800bed20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b700099e0 tx=0x7f6b70009250 comp rx=0 tx=0).stop 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 -- 172.21.15.53:0/912353461 shutdown_connections 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 --2- 172.21.15.53:0/912353461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b8014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 --2- 172.21.15.53:0/912353461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b800bed20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 -- 172.21.15.53:0/912353461 >> 172.21.15.53:0/912353461 conn(0x7f6b80067630 msgr2=0x7f6b80067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 -- 172.21.15.53:0/912353461 shutdown_connections 2023-09-28T00:23:19.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.862+0000 7f6b8559d700 1 -- 172.21.15.53:0/912353461 wait complete. 2023-09-28T00:23:19.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.863+0000 7f6b8559d700 1 Processor -- start 2023-09-28T00:23:19.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.863+0000 7f6b8559d700 1 -- start start 2023-09-28T00:23:19.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b8559d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b801668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b8559d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b80164900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b8559d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b800c4fe0 0x7f6b80164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b8559d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8015aeb0 con 0x7f6b800c0990 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b8559d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8015a8f0 con 0x7f6b800c4fe0 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b8559d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8015a1d0 con 0x7f6b800c0d60 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b7ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b801668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b7ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b801668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48254/0 (socket says 172.21.15.53:48254) 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.864+0000 7f6b7ffff700 1 -- 172.21.15.53:0/2643618116 learned_addr learned my addr 172.21.15.53:0/2643618116 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b800c4fe0 0x7f6b80164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b80164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7ffff700 1 -- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 msgr2=0x7f6b80164900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b80164900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7ffff700 1 -- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b800c4fe0 msgr2=0x7f6b80164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b800c4fe0 0x7f6b80164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7ffff700 1 -- 172.21.15.53:0/2643618116 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700094f0 con 0x7f6b800c0990 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b800c4fe0 0x7f6b80164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b801668e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b8006d6b0 tx=0x7f6b70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b67fff700 1 -- 172.21.15.53:0/2643618116 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011e20 con 0x7f6b800c0990 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b67fff700 1 -- 172.21.15.53:0/2643618116 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70024440 con 0x7f6b800c0990 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b67fff700 1 -- 172.21.15.53:0/2643618116 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70024800 con 0x7f6b800c0990 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.865+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b80167360 con 0x7f6b800c0990 2023-09-28T00:23:19.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.866+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b801492f0 con 0x7f6b800c0990 2023-09-28T00:23:19.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.867+0000 7f6b67fff700 1 -- 172.21.15.53:0/2643618116 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6b7002d440 con 0x7f6b800c0990 2023-09-28T00:23:19.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.868+0000 7f6b67fff700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6b6c067330 0x7f6b6c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.868+0000 7f6b67fff700 1 -- 172.21.15.53:0/2643618116 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6b70086640 con 0x7f6b800c0990 2023-09-28T00:23:19.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.869+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6b6c067330 0x7f6b6c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.869+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6b6c067330 0x7f6b6c0697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b74007fd0 tx=0x7f6b74007e10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.870+0000 7f6b94e3fb80 1 Processor -- start 2023-09-28T00:23:19.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.870+0000 7f6b94e3fb80 1 -- start start 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e299c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7e2c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e222d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7d3da70 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7d3b270 con 0x55fcb7de4e60 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7d37060 con 0x55fcb7e281e0 2023-09-28T00:23:19.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b84d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b84d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48260/0 (socket says 172.21.15.53:48260) 2023-09-28T00:23:19.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4078250451 learned_addr learned my addr 172.21.15.53:0/4078250451 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7e2c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.871+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 msgr2=0x55fcb7e299c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e299c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 msgr2=0x55fcb7e2c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7e2c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4078250451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcb7bd1270 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e222d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b78007640 tx=0x7f6b7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca596503bc8b5d8f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b65ffb700 1 -- 172.21.15.53:0/4078250451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800e030 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b65ffb700 1 -- 172.21.15.53:0/4078250451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78015600 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.872+0000 7f6b65ffb700 1 -- 172.21.15.53:0/4078250451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78015980 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4078250451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 msgr2=0x55fcb7e222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e222d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b78007640 tx=0x7f6b7800b040 comp rx=0 tx=0).stop 2023-09-28T00:23:19.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4078250451 shutdown_connections 2023-09-28T00:23:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e299c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e222d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4078250451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7e2c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4078250451 >> 172.21.15.53:0/4078250451 conn(0x55fcb7de6260 msgr2=0x55fcb7de6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4078250451 shutdown_connections 2023-09-28T00:23:19.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.873+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4078250451 wait complete. 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.874+0000 7f6b94e3fb80 1 -- start start 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.874+0000 7f6b94e3fb80 1 Processor -- start 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 0x55fcb7e20c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e22ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7ce2890 con 0x55fcb7de4e60 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7cfdea0 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7bb9e30 con 0x55fcb7e281e0 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b94e3fb80 10 client.0 _ll_register_callbacks cb 0x55fcb7daa020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 0x55fcb7e20c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 0x55fcb7e20c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48274/0 (socket says 172.21.15.53:48274) 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 -- 172.21.15.53:0/4289541212 learned_addr learned my addr 172.21.15.53:0/4289541212 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e22ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 -- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 msgr2=0x55fcb7e206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 -- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e2cbb0 msgr2=0x55fcb7e22ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e22ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.875+0000 7f6b7ffff700 1 -- 172.21.15.53:0/4289541212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78007340 con 0x55fcb7de4e60 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 0x55fcb7e20c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b700570f0 tx=0x7f6b70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ea0098b1f54218 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b5e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4289541212 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700571e0 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4289541212 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6b7005a3b0 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcb7ddb940 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4289541212 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b7005e100 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 10 client.4719 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fcb7b73fe0 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4289541212 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fcb7ddb940 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4289541212 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f6b7002c3a0 con 0x55fcb7de4e60 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 10 client.4719 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 10 client.4719 resolve_mds: resolved name 'f' to daemon mds.f 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 20 client.4719 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7e20220 0x55fcb7e1d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 4 client.4719 mds_command: new command op to 4271 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.876+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 --> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcb7db8870 con 0x55fcb7e20220 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.877+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7e20220 0x55fcb7e1d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.877+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7e20220 0x55fcb7e1d970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87f50329ad75077 server_cookie=9a3a850686ff311f in_seq=0 out_seq=0 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.877+0000 7f6b5e7fc700 10 client.4719 ms_handle_connect on v2:172.21.15.118:6838/853666591 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4289541212 <== mds.3 v2:172.21.15.118:6838/853666591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fcb7db8870 con 0x55fcb7e20220 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b5e7fc700 10 client.4719 handle_command_reply: tid=0 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 client.4719 shutdown 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 msgr2=0x55fcb7e20c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 0x55fcb7e20c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b700570f0 tx=0x7f6b70009250 comp rx=0 tx=0).stop 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 shutdown_connections 2023-09-28T00:23:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7e20220 0x55fcb7e1d970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7e22ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7de4e60 0x55fcb7e20c90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4289541212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7e206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b5e7fc700 0 client.4719 ms_handle_reset on v2:172.21.15.118:6838/853666591 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 >> 172.21.15.53:0/4289541212 conn(0x55fcb7de6260 msgr2=0x55fcb7e285b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 shutdown_connections 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.878+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4289541212 wait complete. 2023-09-28T00:23:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.879+0000 7f6b94e3fb80 20 client.4719 trim_cache size 0 max 16384 2023-09-28T00:23:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.896+0000 7f6b94e3fb80 1 Processor -- start 2023-09-28T00:23:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.896+0000 7f6b94e3fb80 1 -- start start 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7ddd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7ddd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7de4d20 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7e26c00 con 0x55fcb7de4e60 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7e190e0 con 0x55fcb7e281e0 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b84d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b84d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48284/0 (socket says 172.21.15.53:48284) 2023-09-28T00:23:19.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b84d9c700 1 -- 172.21.15.53:0/2192044378 learned_addr learned my addr 172.21.15.53:0/2192044378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7ddd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.897+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7ddd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b84d9c700 1 -- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 msgr2=0x55fcb7ddd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7ddd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b84d9c700 1 -- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 msgr2=0x55fcb7ddd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7ddd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b84d9c700 1 -- 172.21.15.53:0/2192044378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcb7d05780 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7ddd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7ddd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de8ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b78007610 tx=0x7f6b7801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea780101af37d193 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b667fc700 1 -- 172.21.15.53:0/2192044378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800e070 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b667fc700 1 -- 172.21.15.53:0/2192044378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78000f40 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.898+0000 7f6b667fc700 1 -- 172.21.15.53:0/2192044378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78025070 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/2192044378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 msgr2=0x55fcb7de8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de8ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b78007610 tx=0x7f6b7801b000 comp rx=0 tx=0).stop 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/2192044378 shutdown_connections 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de8ad0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7de4e60 0x55fcb7ddd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/2192044378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7e281e0 0x55fcb7ddd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/2192044378 >> 172.21.15.53:0/2192044378 conn(0x55fcb7de6260 msgr2=0x55fcb7dea4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/2192044378 shutdown_connections 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/2192044378 wait complete. 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.899+0000 7f6b94e3fb80 1 -- start start 2023-09-28T00:23:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 Processor -- start 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7de4e60 0x55fcb7e15500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e281e0 0x55fcb7de2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7e2c090 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7e15a40 con 0x55fcb7e281e0 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcb7e965f0 con 0x55fcb7de4e60 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.900+0000 7f6b94e3fb80 10 client.0 _ll_register_callbacks cb 0x55fcb7daa020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48294/0 (socket says 172.21.15.53:48294) 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b7ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7de4e60 0x55fcb7e15500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4184260196 learned_addr learned my addr 172.21.15.53:0/4184260196 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b7f7fe700 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e281e0 0x55fcb7de2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7de4e60 msgr2=0x55fcb7e15500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7de4e60 0x55fcb7e15500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e281e0 msgr2=0x55fcb7de2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e281e0 0x55fcb7de2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 -- 172.21.15.53:0/4184260196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fcb7b73fe0 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b84d9c700 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de3010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b78017000 tx=0x7f6b78025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c21920fcf74d452 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.901+0000 7f6b5e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4184260196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800e040 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b78015600 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4184260196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6b7800f070 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4184260196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b78015980 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 10 client.4725 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f6b7400f040 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4184260196 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78015600 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4184260196 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f6b78014070 con 0x55fcb7e2cbb0 2023-09-28T00:23:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 10 client.4725 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 10 client.4725 resolve_mds: resolved name 'f' to daemon mds.f 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 20 client.4725 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7de3550 0x55fcb7e8c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 4 client.4725 mds_command: new command op to 4271 tid=0[{"prefix": "status"}] 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.902+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 --> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fcb7cd9e00 con 0x55fcb7de3550 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7de3550 0x55fcb7e8c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b7ffff700 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7de3550 0x55fcb7e8c330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5cb5ce1b55070c25 server_cookie=9bacb12bde9725f2 in_seq=0 out_seq=0 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b5e7fc700 10 client.4725 ms_handle_connect on v2:172.21.15.118:6838/853666591 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b5e7fc700 1 -- 172.21.15.53:0/4184260196 <== mds.3 v2:172.21.15.118:6838/853666591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fcb7cd9e00 con 0x55fcb7de3550 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b5e7fc700 10 client.4725 handle_command_reply: tid=0 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b94e3fb80 1 client.4725 shutdown 2023-09-28T00:23:19.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 msgr2=0x55fcb7de3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.903+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de3010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b78017000 tx=0x7f6b78025000 comp rx=0 tx=0).stop 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 shutdown_connections 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:6838/853666591,v1:172.21.15.118:6839/853666591] conn(0x55fcb7de3550 0x55fcb7e8c330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55fcb7de4e60 0x55fcb7e15500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fcb7e2cbb0 0x55fcb7de3010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 --2- 172.21.15.53:0/4184260196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fcb7e281e0 0x55fcb7de2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b5e7fc700 0 client.4725 ms_handle_reset on v2:172.21.15.118:6838/853666591 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 >> 172.21.15.53:0/4184260196 conn(0x55fcb7de6260 msgr2=0x55fcb7ddd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 shutdown_connections 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 1 -- 172.21.15.53:0/4184260196 wait complete. 2023-09-28T00:23:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b94e3fb80 20 client.4725 trim_cache size 0 max 16384 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "95448d9d-c293-4b2c-9850-98d8a7632343", 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 3, 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4271, 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 15.192941389, 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 16, 2023-09-28T00:23:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 25, 2023-09-28T00:23:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 25, 2023-09-28T00:23:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 25.611143247000001 2023-09-28T00:23:19.911 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6b6c067330 msgr2=0x7f6b6c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6b6c067330 0x7f6b6c0697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b74007fd0 tx=0x7f6b74007e10 comp rx=0 tx=0).stop 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 msgr2=0x7f6b801668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b801668e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b8006d6b0 tx=0x7f6b70017000 comp rx=0 tx=0).stop 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 shutdown_connections 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6b6c067330 0x7f6b6c0697e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b800c4fe0 0x7f6b80164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b800c0990 0x7f6b801668e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 --2- 172.21.15.53:0/2643618116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b800c0d60 0x7f6b80164900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.904+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 >> 172.21.15.53:0/2643618116 conn(0x7f6b80067630 msgr2=0x7f6b800c11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:19.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.905+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 shutdown_connections 2023-09-28T00:23:19.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:19.905+0000 7f6b8559d700 1 -- 172.21.15.53:0/2643618116 wait complete. 2023-09-28T00:23:19.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-09-28T00:23:20.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.112+0000 7f0151d9d700 1 Processor -- start 2023-09-28T00:23:20.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.112+0000 7f0151d9d700 1 -- start start 2023-09-28T00:23:20.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0151d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f014c0c0e10 0x7f014c159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0151d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f014c13ed20 0x7f014c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0151d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c156040 con 0x7f014c0c11e0 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0151d9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0c6cf0 con 0x7f014c0c0e10 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0151d9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0c6730 con 0x7f014c13ed20 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0150d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f014c0c0e10 0x7f014c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0150d9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f014c0c0e10 0x7f014c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48304/0 (socket says 172.21.15.53:48304) 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.113+0000 7f0150d9b700 1 -- 172.21.15.53:0/718501984 learned_addr learned my addr 172.21.15.53:0/718501984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f015159c700 1 --2- 172.21.15.53:0/718501984 >> v2:172.21.15.118:3300/0 conn(0x7f014c13ed20 0x7f014c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f0150d9b700 1 -- 172.21.15.53:0/718501984 >> v2:172.21.15.118:3300/0 conn(0x7f014c13ed20 msgr2=0x7f014c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f0150d9b700 1 --2- 172.21.15.53:0/718501984 >> v2:172.21.15.118:3300/0 conn(0x7f014c13ed20 0x7f014c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f0150d9b700 1 -- 172.21.15.53:0/718501984 >> v1:172.21.15.118:6789/0 conn(0x7f014c0c11e0 legacy=0x7f014c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f0150d9b700 1 -- 172.21.15.53:0/718501984 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0c6a10 con 0x7f014c0c0e10 2023-09-28T00:23:20.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f0150d9b700 1 --2- 172.21.15.53:0/718501984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c0c0e10 0x7f014c159840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f014c1501f0 tx=0x7f0140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370fd0e9027a5a21 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f014b7fe700 1 -- 172.21.15.53:0/718501984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000e070 con 0x7f014c0c0e10 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f014b7fe700 1 -- 172.21.15.53:0/718501984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000ba50 con 0x7f014c0c0e10 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.114+0000 7f014b7fe700 1 -- 172.21.15.53:0/718501984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400092e0 con 0x7f014c0c0e10 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 -- 172.21.15.53:0/718501984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c0c0e10 msgr2=0x7f014c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 --2- 172.21.15.53:0/718501984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c0c0e10 0x7f014c159840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f014c1501f0 tx=0x7f0140009840 comp rx=0 tx=0).stop 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 -- 172.21.15.53:0/718501984 shutdown_connections 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 --2- 172.21.15.53:0/718501984 >> v2:172.21.15.118:3300/0 conn(0x7f014c13ed20 0x7f014c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 --2- 172.21.15.53:0/718501984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c0c0e10 0x7f014c159840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 -- 172.21.15.53:0/718501984 >> 172.21.15.53:0/718501984 conn(0x7f014c06f830 msgr2=0x7f014c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 -- 172.21.15.53:0/718501984 shutdown_connections 2023-09-28T00:23:20.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.115+0000 7f0151d9d700 1 -- 172.21.15.53:0/718501984 wait complete. 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.116+0000 7f0151d9d700 1 Processor -- start 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 -- start start 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f014c0c0e10 0x7f014c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f014c0c11e0 0x7f014c166200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 0x7f014c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b12a0 con 0x7f014c13ed20 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c165d70 con 0x7f014c0c11e0 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.117+0000 7f0151d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c1699b0 con 0x7f014c0c0e10 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 0x7f014c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 0x7f014c13b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48314/0 (socket says 172.21.15.53:48314) 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 -- 172.21.15.53:0/2829616173 learned_addr learned my addr 172.21.15.53:0/2829616173 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f0150d9b700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f014c0c0e10 0x7f014c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f014bfff700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f014c0c11e0 0x7f014c166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 -- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f014c0c0e10 msgr2=0x7f014c1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f014c0c0e10 0x7f014c1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 -- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f014c0c11e0 msgr2=0x7f014c166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f014c0c11e0 0x7f014c166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 -- 172.21.15.53:0/2829616173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140009ae0 con 0x7f014c13ed20 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f015159c700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 0x7f014c13b210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f014400d890 tx=0x7f0144008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.118+0000 7f0148ff9700 1 -- 172.21.15.53:0/2829616173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144018070 con 0x7f014c13ed20 2023-09-28T00:23:20.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.119+0000 7f0148ff9700 1 -- 172.21.15.53:0/2829616173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440125f0 con 0x7f014c13ed20 2023-09-28T00:23:20.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.119+0000 7f0148ff9700 1 -- 172.21.15.53:0/2829616173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144012990 con 0x7f014c13ed20 2023-09-28T00:23:20.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.119+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c165a20 con 0x7f014c13ed20 2023-09-28T00:23:20.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.119+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0b14f0 con 0x7f014c13ed20 2023-09-28T00:23:20.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.121+0000 7f0148ff9700 1 -- 172.21.15.53:0/2829616173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0144014430 con 0x7f014c13ed20 2023-09-28T00:23:20.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.121+0000 7f0148ff9700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0130067360 0x7f0130069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.122+0000 7f0148ff9700 1 -- 172.21.15.53:0/2829616173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0144084c60 con 0x7f014c13ed20 2023-09-28T00:23:20.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.122+0000 7f0150d9b700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0130067360 0x7f0130069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.123+0000 7f0150d9b700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0130067360 0x7f0130069810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0140009880 tx=0x7f0140018000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.124+0000 7f016176bb80 1 Processor -- start 2023-09-28T00:23:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.124+0000 7f016176bb80 1 -- start start 2023-09-28T00:23:20.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.124+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.124+0000 7f016176bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af03670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.124+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aef92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.124+0000 7f016176bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ae14a70 con 0x56230aebbe60 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ae12270 con 0x56230af03bb0 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56230ae0e060 con 0x56230aeff1e0 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af03670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f0150d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f015159c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aef92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f0150d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af009c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:48760/0 (socket says 172.21.15.53:48760) 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af03670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48318/0 (socket says 172.21.15.53:48318) 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f0150d9b700 1 -- 172.21.15.53:0/3189324975 learned_addr learned my addr 172.21.15.53:0/3189324975 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 -- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 msgr2=0x56230af009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 -- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 msgr2=0x56230aef92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aef92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 -- 172.21.15.53:0/3189324975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56230aca8270 con 0x56230aebbe60 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f015159c700 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aef92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.125+0000 7f014bfff700 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af03670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01380037a0 tx=0x7f0138007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4498b84dfaa7ba1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f0135ffb700 1 -- 172.21.15.53:0/3189324975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138002530 con 0x56230aebbe60 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f0135ffb700 1 -- 172.21.15.53:0/3189324975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138002690 con 0x56230aebbe60 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f0135ffb700 1 -- 172.21.15.53:0/3189324975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138002a10 con 0x56230aebbe60 2023-09-28T00:23:20.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 -- 172.21.15.53:0/3189324975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 msgr2=0x56230af03670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af03670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01380037a0 tx=0x7f0138007ec0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 -- 172.21.15.53:0/3189324975 shutdown_connections 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aef92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 --2- 172.21.15.53:0/3189324975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af03670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 -- 172.21.15.53:0/3189324975 >> 172.21.15.53:0/3189324975 conn(0x56230aebd260 msgr2=0x56230aebd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 -- 172.21.15.53:0/3189324975 shutdown_connections 2023-09-28T00:23:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.126+0000 7f016176bb80 1 -- 172.21.15.53:0/3189324975 wait complete. 2023-09-28T00:23:20.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.127+0000 7f016176bb80 1 -- start start 2023-09-28T00:23:20.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.127+0000 7f016176bb80 1 Processor -- start 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aebbe60 0x56230af0f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 0x56230aef95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230af03bb0 0x56230aef0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230adb9890 con 0x56230aeff1e0 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230add4ea0 con 0x56230aebbe60 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56230ac90e30 con 0x56230af03bb0 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f016176bb80 10 client.0 _ll_register_callbacks cb 0x56230ae81020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f014bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 0x56230aef95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f014bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 0x56230aef95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48330/0 (socket says 172.21.15.53:48330) 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.128+0000 7f014bfff700 1 -- 172.21.15.53:0/65077427 learned_addr learned my addr 172.21.15.53:0/65077427 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f0150d9b700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aebbe60 0x56230af0f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f015159c700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230af03bb0 0x56230aef0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f014bfff700 1 -- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230af03bb0 msgr2=0x56230aef0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f014bfff700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230af03bb0 0x56230aef0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f014bfff700 1 -- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aebbe60 msgr2=0x56230af0f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f014bfff700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aebbe60 0x56230af0f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f014bfff700 1 -- 172.21.15.53:0/65077427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0b14f0 con 0x56230aeff1e0 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f015159c700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230af03bb0 0x56230aef0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f0150d9b700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aebbe60 0x56230af0f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f014bfff700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 0x56230aef95b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0138003b60 tx=0x7f0138018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47bb3df78d0236d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f012affd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f012affd700 1 -- 172.21.15.53:0/65077427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138006a30 con 0x56230aeff1e0 2023-09-28T00:23:20.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f012affd700 1 -- 172.21.15.53:0/65077427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0138006b90 con 0x56230aeff1e0 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.129+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56230aeb2940 con 0x56230aeff1e0 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f012affd700 1 -- 172.21.15.53:0/65077427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0138007030 con 0x56230aeff1e0 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 10 client.4737 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f014c156040 con 0x56230aeff1e0 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f012affd700 1 -- 172.21.15.53:0/65077427 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56230aeb2940 con 0x56230aeff1e0 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f012affd700 1 -- 172.21.15.53:0/65077427 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f0138003040 con 0x56230aeff1e0 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 10 client.4737 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 10 client.4737 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 20 client.4737 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af12a60 0x56230af12e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 4 client.4737 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T00:23:20.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 --> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56230ae8f870 con 0x56230af12a60 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.130+0000 7f0150d9b700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af12a60 0x56230af12e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.131+0000 7f0150d9b700 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af12a60 0x56230af12e30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8a8c1409bae9856 server_cookie=ae3b0ddc152c5580 in_seq=0 out_seq=0 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.131+0000 7f012affd700 10 client.4737 ms_handle_connect on v2:172.21.15.53:6835/3451016827 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f012affd700 1 -- 172.21.15.53:0/65077427 <== mds.2 v2:172.21.15.53:6835/3451016827 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56230ae8f870 con 0x56230af12a60 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f012affd700 10 client.4737 handle_command_reply: tid=0 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 client.4737 shutdown 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 msgr2=0x56230aef95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 0x56230aef95b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0138003b60 tx=0x7f0138018000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 shutdown_connections 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af12a60 0x56230af12e30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230af03bb0 0x56230aef0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aebbe60 0x56230af0f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 --2- 172.21.15.53:0/65077427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aeff1e0 0x56230aef95b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f012affd700 0 client.4737 ms_handle_reset on v2:172.21.15.53:6835/3451016827 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 >> 172.21.15.53:0/65077427 conn(0x56230aebd260 msgr2=0x56230aeff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 shutdown_connections 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 1 -- 172.21.15.53:0/65077427 wait complete. 2023-09-28T00:23:20.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.132+0000 7f016176bb80 20 client.4737 trim_cache size 0 max 16384 2023-09-28T00:23:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.150+0000 7f016176bb80 1 Processor -- start 2023-09-28T00:23:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.150+0000 7f016176bb80 1 -- start start 2023-09-28T00:23:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.150+0000 7f016176bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af02b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.150+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af03070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.150+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aeb4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f016176bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230aeffd20 con 0x56230aebbe60 2023-09-28T00:23:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230af03940 con 0x56230af03bb0 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56230aef0c50 con 0x56230aeff1e0 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af02b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af02b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48338/0 (socket says 172.21.15.53:48338) 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 -- 172.21.15.53:0/4142802597 learned_addr learned my addr 172.21.15.53:0/4142802597 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f014bfff700 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af03070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f015159c700 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aeb4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 -- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 msgr2=0x56230af03070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af03070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 -- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 msgr2=0x56230aeb4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aeb4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 -- 172.21.15.53:0/4142802597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56230ac4afe0 con 0x56230aebbe60 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.151+0000 7f0150d9b700 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af02b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f014000bc50 tx=0x7f014002a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f444f819e8856f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f01367fc700 1 -- 172.21.15.53:0/4142802597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140030040 con 0x56230aebbe60 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f01367fc700 1 -- 172.21.15.53:0/4142802597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140007ac0 con 0x56230aebbe60 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f01367fc700 1 -- 172.21.15.53:0/4142802597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140034250 con 0x56230aebbe60 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 -- 172.21.15.53:0/4142802597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 msgr2=0x56230af02b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af02b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f014000bc50 tx=0x7f014002a040 comp rx=0 tx=0).stop 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 -- 172.21.15.53:0/4142802597 shutdown_connections 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230af03bb0 0x56230aeb4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230aebbe60 0x56230af02b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 --2- 172.21.15.53:0/4142802597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aeff1e0 0x56230af03070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 -- 172.21.15.53:0/4142802597 >> 172.21.15.53:0/4142802597 conn(0x56230aebd260 msgr2=0x56230aebd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 -- 172.21.15.53:0/4142802597 shutdown_connections 2023-09-28T00:23:20.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.152+0000 7f016176bb80 1 -- 172.21.15.53:0/4142802597 wait complete. 2023-09-28T00:23:20.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.153+0000 7f016176bb80 1 -- start start 2023-09-28T00:23:20.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.153+0000 7f016176bb80 1 Processor -- start 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aebbe60 0x56230aeb47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aeff1e0 0x56230af13200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 0x56230af68760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230af65380 con 0x56230af03bb0 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230aec14a0 con 0x56230aeff1e0 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x56230af651e0 con 0x56230aebbe60 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f016176bb80 10 client.0 _ll_register_callbacks cb 0x56230ae81020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 0x56230af68760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 0x56230af68760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48340/0 (socket says 172.21.15.53:48340) 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 -- 172.21.15.53:0/3881293538 learned_addr learned my addr 172.21.15.53:0/3881293538 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f0150d9b700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aebbe60 0x56230aeb47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f014bfff700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aeff1e0 0x56230af13200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 -- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aebbe60 msgr2=0x56230aeb47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aebbe60 0x56230aeb47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 -- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aeff1e0 msgr2=0x56230af13200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aeff1e0 0x56230af13200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.154+0000 7f015159c700 1 -- 172.21.15.53:0/3881293538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0c6a10 con 0x56230af03bb0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f015159c700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 0x56230af68760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0144055480 tx=0x7f0144082ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67552f1f75be6fd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f012affd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f012affd700 1 -- 172.21.15.53:0/3881293538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014405c720 con 0x56230af03bb0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f012affd700 1 -- 172.21.15.53:0/3881293538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f01440559e0 con 0x56230af03bb0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0138002690 con 0x56230af03bb0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f012affd700 1 -- 172.21.15.53:0/3881293538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0144054c70 con 0x56230af03bb0 2023-09-28T00:23:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 10 client.4743 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56230addc780 con 0x56230af03bb0 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f012affd700 1 -- 172.21.15.53:0/3881293538 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138002690 con 0x56230af03bb0 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f012affd700 1 -- 172.21.15.53:0/3881293538 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7f014405c290 con 0x56230af03bb0 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 10 client.4743 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 10 client.4743 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 20 client.4743 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af69330 0x56230af5eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 4 client.4743 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.155+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 --> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56230adb0e00 con 0x56230af69330 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f0150d9b700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af69330 0x56230af5eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f0150d9b700 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af69330 0x56230af5eaa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=893d78e920a686ab server_cookie=4c2790fb42a1ae44 in_seq=0 out_seq=0 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f012affd700 10 client.4743 ms_handle_connect on v2:172.21.15.53:6835/3451016827 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f012affd700 1 -- 172.21.15.53:0/3881293538 <== mds.2 v2:172.21.15.53:6835/3451016827 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56230adb0e00 con 0x56230af69330 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f012affd700 10 client.4743 handle_command_reply: tid=0 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f016176bb80 1 client.4743 shutdown 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 msgr2=0x56230af68760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.156+0000 7f016176bb80 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 0x56230af68760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0144055480 tx=0x7f0144082ee0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 shutdown_connections 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:6835/3451016827,v1:172.21.15.53:6837/3451016827] conn(0x56230af69330 0x56230af5eaa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x56230aebbe60 0x56230aeb47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56230af03bb0 0x56230af68760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 --2- 172.21.15.53:0/3881293538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56230aeff1e0 0x56230af13200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 >> 172.21.15.53:0/3881293538 conn(0x56230aebd260 msgr2=0x56230af06780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f012affd700 0 client.4743 ms_handle_reset on v2:172.21.15.53:6835/3451016827 2023-09-28T00:23:20.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 shutdown_connections 2023-09-28T00:23:20.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 1 -- 172.21.15.53:0/3881293538 wait complete. 2023-09-28T00:23:20.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f016176bb80 20 client.4743 trim_cache size 0 max 16384 2023-09-28T00:23:20.165 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "95448d9d-c293-4b2c-9850-98d8a7632343", 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 2, 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4291, 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 16.450384934999999, 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 16, 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 25, 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 25, 2023-09-28T00:23:20.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 25.800517446000001 2023-09-28T00:23:20.167 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:20.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0130067360 msgr2=0x7f0130069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0130067360 0x7f0130069810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0140009880 tx=0x7f0140018000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 msgr2=0x7f014c13b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 0x7f014c13b210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f014400d890 tx=0x7f0144008040 comp rx=0 tx=0).stop 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 shutdown_connections 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0130067360 0x7f0130069810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f014c0c0e10 0x7f014c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.157+0000 7f0151d9d700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f014c13ed20 0x7f014c13b210 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.158+0000 7f0151d9d700 1 --2- 172.21.15.53:0/2829616173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f014c0c11e0 0x7f014c166200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.158+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 >> 172.21.15.53:0/2829616173 conn(0x7f014c06f830 msgr2=0x7f014c0cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.158+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 shutdown_connections 2023-09-28T00:23:20.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.158+0000 7f0151d9d700 1 -- 172.21.15.53:0/2829616173 wait complete. 2023-09-28T00:23:20.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-28T00:23:20.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.363+0000 7fe3d9b9d700 1 Processor -- start 2023-09-28T00:23:20.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.363+0000 7fe3d9b9d700 1 -- start start 2023-09-28T00:23:20.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.364+0000 7fe3d9b9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3d414f7c0 0x7fe3d406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.364+0000 7fe3d9b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d406c550 0x7fe3d406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.364+0000 7fe3d9b9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 0x7fe3d4155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.364+0000 7fe3d9b9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d40c5070 con 0x7fe3d4155750 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.364+0000 7fe3d9b9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d4159970 con 0x7fe3d414f7c0 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.364+0000 7fe3d9b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d406cab0 con 0x7fe3d406c550 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3d414f7c0 0x7fe3d406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d939c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 0x7fe3d4155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d406c550 0x7fe3d406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d406c550 0x7fe3d406f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:48798/0 (socket says 172.21.15.53:48798) 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d939c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 0x7fe3d4155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48348/0 (socket says 172.21.15.53:48348) 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3d414f7c0 0x7fe3d406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:47274/0 (socket says 172.21.15.53:47274) 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d3fff700 1 -- 172.21.15.53:0/1670031706 learned_addr learned my addr 172.21.15.53:0/1670031706 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d406c550 msgr2=0x7fe3d406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d406c550 0x7fe3d406f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1670031706 >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 msgr2=0x7fe3d4155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/1670031706 >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 0x7fe3d4155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1670031706 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4156130 con 0x7fe3d414f7c0 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d939c700 1 --2- 172.21.15.53:0/1670031706 >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 0x7fe3d4155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.365+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d414f7c0 0x7fe3d406f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40c9b20 tx=0x7fe3c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf0f5908950228c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d37fe700 1 -- 172.21.15.53:0/1670031706 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8011630 con 0x7fe3d414f7c0 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d37fe700 1 -- 172.21.15.53:0/1670031706 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c80117b0 con 0x7fe3d414f7c0 2023-09-28T00:23:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d37fe700 1 -- 172.21.15.53:0/1670031706 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8011b70 con 0x7fe3d414f7c0 2023-09-28T00:23:20.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d414f7c0 msgr2=0x7fe3d406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d414f7c0 0x7fe3d406f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40c9b20 tx=0x7fe3c80091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1670031706 shutdown_connections 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1670031706 >> v2:172.21.15.53:3300/0 conn(0x7fe3d4155750 0x7fe3d4155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d414f7c0 0x7fe3d406f120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1670031706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d406c550 0x7fe3d406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1670031706 >> 172.21.15.53:0/1670031706 conn(0x7fe3d4068740 msgr2=0x7fe3d4068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1670031706 shutdown_connections 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.366+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1670031706 wait complete. 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.368+0000 7fe3d9b9d700 1 Processor -- start 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.368+0000 7fe3d9b9d700 1 -- start start 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d9b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 0x7fe3d40c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d9b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d414f7c0 0x7fe3d4166b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d9b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d4155750 0x7fe3d414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d9b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d414e3a0 con 0x7fe3d406c550 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d9b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41665b0 con 0x7fe3d4155750 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d9b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4169640 con 0x7fe3d414f7c0 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d8b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 0x7fe3d40c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d414f7c0 0x7fe3d4166b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d4155750 0x7fe3d414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d8b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 0x7fe3d40c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48352/0 (socket says 172.21.15.53:48352) 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1571953272 learned_addr learned my addr 172.21.15.53:0/1571953272 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d414f7c0 msgr2=0x7fe3d4166b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.369+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d414f7c0 0x7fe3d4166b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d4155750 msgr2=0x7fe3d414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d4155750 0x7fe3d414b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/1571953272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc009a20 con 0x7fe3d406c550 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 0x7fe3d40c5bc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40c0220 tx=0x7fe3c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d0ff9700 1 -- 172.21.15.53:0/1571953272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c801f070 con 0x7fe3d406c550 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d0ff9700 1 -- 172.21.15.53:0/1571953272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8011920 con 0x7fe3d406c550 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c8009420 con 0x7fe3d406c550 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d0ff9700 1 -- 172.21.15.53:0/1571953272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8023410 con 0x7fe3d406c550 2023-09-28T00:23:20.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.370+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d41662f0 con 0x7fe3d406c550 2023-09-28T00:23:20.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.372+0000 7fe3d0ff9700 1 -- 172.21.15.53:0/1571953272 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe3c80237a0 con 0x7fe3d406c550 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.373+0000 7fe3d0ff9700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3b8067360 0x7fe3b8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.373+0000 7fe3d0ff9700 1 -- 172.21.15.53:0/1571953272 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3c8085ec0 con 0x7fe3d406c550 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.373+0000 7fe3d3fff700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3b8067360 0x7fe3b8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.374+0000 7fe3d3fff700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3b8067360 0x7fe3b8069810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4159210 tx=0x7fe3c0009250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.375+0000 7fe3e955eb80 1 Processor -- start 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.375+0000 7fe3e955eb80 1 -- start start 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94d8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b93e9a70 con 0x55c1b94d8bb0 2023-09-28T00:23:20.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b93e7270 con 0x55c1b94d41e0 2023-09-28T00:23:20.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1b93e3060 con 0x55c1b9490e60 2023-09-28T00:23:20.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3d8b9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48356/0 (socket says 172.21.15.53:48356) 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.376+0000 7fe3d939c700 1 -- 172.21.15.53:0/891493302 learned_addr learned my addr 172.21.15.53:0/891493302 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3d939c700 1 -- 172.21.15.53:0/891493302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 msgr2=0x55c1b94d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3d939c700 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94d8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3d939c700 1 -- 172.21.15.53:0/891493302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 msgr2=0x55c1b94d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3d939c700 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3d939c700 1 -- 172.21.15.53:0/891493302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1b927d270 con 0x55c1b94d8bb0 2023-09-28T00:23:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3d939c700 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94ce2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc011610 tx=0x7fe3cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82069544f44b8437 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3bdffb700 1 -- 172.21.15.53:0/891493302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00e040 con 0x55c1b94d8bb0 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3bdffb700 1 -- 172.21.15.53:0/891493302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00f040 con 0x55c1b94d8bb0 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.377+0000 7fe3bdffb700 1 -- 172.21.15.53:0/891493302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc015870 con 0x55c1b94d8bb0 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 -- 172.21.15.53:0/891493302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 msgr2=0x55c1b94ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94ce2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc011610 tx=0x7fe3cc00b040 comp rx=0 tx=0).stop 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 -- 172.21.15.53:0/891493302 shutdown_connections 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94ce2d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/891493302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94d8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 -- 172.21.15.53:0/891493302 >> 172.21.15.53:0/891493302 conn(0x55c1b9492260 msgr2=0x55c1b9492630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 -- 172.21.15.53:0/891493302 shutdown_connections 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.378+0000 7fe3e955eb80 1 -- 172.21.15.53:0/891493302 wait complete. 2023-09-28T00:23:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.379+0000 7fe3e955eb80 1 -- start start 2023-09-28T00:23:20.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.379+0000 7fe3e955eb80 1 Processor -- start 2023-09-28T00:23:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94d65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b938e890 con 0x55c1b94d8bb0 2023-09-28T00:23:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b93a9ea0 con 0x55c1b94d41e0 2023-09-28T00:23:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1b9265e30 con 0x55c1b9490e60 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3e955eb80 10 client.0 _ll_register_callbacks cb 0x55c1b9456020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94d65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d8b9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:47296/0 (socket says 172.21.15.53:47296) 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d3fff700 1 -- 172.21.15.53:0/2011802921 learned_addr learned my addr 172.21.15.53:0/2011802921 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94d65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48372/0 (socket says 172.21.15.53:48372) 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 -- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 msgr2=0x55c1b94ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 -- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 msgr2=0x55c1b94d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d939c700 1 -- 172.21.15.53:0/2011802921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc011310 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.380+0000 7fe3d3fff700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3d939c700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94d65b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc01a000 tx=0x7fe3cc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9960984ac413f20 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/2011802921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc022070 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1b9487940 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/2011802921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3cc026410 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/2011802921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3cc00e040 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3e955eb80 10 client.4755 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.381+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c1b921ffe0 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/2011802921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1b9487940 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/2011802921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7fe3cc0267e0 con 0x55c1b94d8bb0 2023-09-28T00:23:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3e955eb80 10 client.4755 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3e955eb80 10 client.4755 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3e955eb80 20 client.4755 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94c42e0 0x55c1b94c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3e955eb80 4 client.4755 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 --> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1b9464870 con 0x55c1b94c42e0 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94c42e0 0x55c1b94c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94c42e0 0x55c1b94c46b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d8d1b4647bf10171 server_cookie=fabc58f6dbfbefba in_seq=0 out_seq=0 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.382+0000 7fe3b2ffd700 10 client.4755 ms_handle_connect on v2:172.21.15.53:6832/2321695931 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.383+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/2011802921 <== mds.1 v2:172.21.15.53:6832/2321695931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c1b9464870 con 0x55c1b94c42e0 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.383+0000 7fe3b2ffd700 10 client.4755 handle_command_reply: tid=0 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.383+0000 7fe3e955eb80 1 client.4755 shutdown 2023-09-28T00:23:20.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.383+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 msgr2=0x55c1b94d65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.383+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94d65b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc01a000 tx=0x7fe3cc01b000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 shutdown_connections 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94c42e0 0x55c1b94c46b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b9490e60 0x55c1b94ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94d65b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/2011802921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b94d6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3b2ffd700 0 client.4755 ms_handle_reset on v2:172.21.15.53:6832/2321695931 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 >> 172.21.15.53:0/2011802921 conn(0x55c1b9492260 msgr2=0x55c1b94d45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 shutdown_connections 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 1 -- 172.21.15.53:0/2011802921 wait complete. 2023-09-28T00:23:20.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.384+0000 7fe3e955eb80 20 client.4755 trim_cache size 0 max 16384 2023-09-28T00:23:20.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.401+0000 7fe3e955eb80 1 Processor -- start 2023-09-28T00:23:20.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.401+0000 7fe3e955eb80 1 -- start start 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b9490e60 0x55c1b9495220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d41e0 0x55c1b94c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b9490a80 con 0x55c1b94d8bb0 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b94cdb40 con 0x55c1b9490e60 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1b94d3b90 con 0x55c1b94d41e0 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48380/0 (socket says 172.21.15.53:48380) 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3d939c700 1 -- 172.21.15.53:0/3873852913 learned_addr learned my addr 172.21.15.53:0/3873852913 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b9490e60 0x55c1b9495220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.402+0000 7fe3d3fff700 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d41e0 0x55c1b94c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d939c700 1 -- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d41e0 msgr2=0x55c1b94c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d939c700 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d41e0 0x55c1b94c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d939c700 1 -- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b9490e60 msgr2=0x55c1b9495220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d939c700 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b9490e60 0x55c1b9495220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d939c700 1 -- 172.21.15.53:0/3873852913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1b93b1780 con 0x55c1b94d8bb0 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b9490e60 0x55c1b9495220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3d939c700 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94c1600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc007990 tx=0x7fe3cc01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23770d002c463d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3be7fc700 1 -- 172.21.15.53:0/3873852913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc022070 con 0x55c1b94d8bb0 2023-09-28T00:23:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3be7fc700 1 -- 172.21.15.53:0/3873852913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc026410 con 0x55c1b94d8bb0 2023-09-28T00:23:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.403+0000 7fe3be7fc700 1 -- 172.21.15.53:0/3873852913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc026ea0 con 0x55c1b94d8bb0 2023-09-28T00:23:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 -- 172.21.15.53:0/3873852913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 msgr2=0x55c1b94c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94c1600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc007990 tx=0x7fe3cc01f050 comp rx=0 tx=0).stop 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 -- 172.21.15.53:0/3873852913 shutdown_connections 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b94d8bb0 0x55c1b94c1600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b9490e60 0x55c1b9495220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/3873852913 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d41e0 0x55c1b94c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 -- 172.21.15.53:0/3873852913 >> 172.21.15.53:0/3873852913 conn(0x55c1b9492260 msgr2=0x55c1b94ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 -- 172.21.15.53:0/3873852913 shutdown_connections 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 -- 172.21.15.53:0/3873852913 wait complete. 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.404+0000 7fe3e955eb80 1 -- start start 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.405+0000 7fe3e955eb80 1 Processor -- start 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 0x55c1b94ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b9495270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d8bb0 0x55c1b9539190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b94d4ac0 con 0x55c1b9490e60 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b94ce8c0 con 0x55c1b94d41e0 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1b94959c0 con 0x55c1b94d8bb0 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3e955eb80 10 client.0 _ll_register_callbacks cb 0x55c1b9456020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 0x55c1b94ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d8bb0 0x55c1b9539190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b9495270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 0x55c1b94ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48390/0 (socket says 172.21.15.53:48390) 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d939c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d8bb0 0x55c1b9539190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:48852/0 (socket says 172.21.15.53:48852) 2023-09-28T00:23:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/422446668 learned_addr learned my addr 172.21.15.53:0/422446668 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/422446668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d8bb0 msgr2=0x55c1b9539190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d8bb0 0x55c1b9539190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/422446668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 msgr2=0x55c1b9495270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b9495270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 -- 172.21.15.53:0/422446668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d41662f0 con 0x55c1b9490e60 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3d8b9b700 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 0x55c1b94ce380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8056750 tx=0x7fe3c8025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836ee97b3f8bc0ea server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.406+0000 7fe3b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/422446668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8056aa0 con 0x55c1b9490e60 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/422446668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3c8059cf0 con 0x55c1b9490e60 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3cc00f040 con 0x55c1b9490e60 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/422446668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3c805da40 con 0x55c1b9490e60 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 10 client.4761 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c1b921ffe0 con 0x55c1b9490e60 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/422446668 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00f040 con 0x55c1b9490e60 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/422446668 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7fe3c8056d00 con 0x55c1b9490e60 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 10 client.4761 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 10 client.4761 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 20 client.4761 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94d19b0 0x55c1b94d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 4 client.4761 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 --> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c1b9385e00 con 0x55c1b94d19b0 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.407+0000 7fe3d3fff700 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94d19b0 0x55c1b94d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3b2ffd700 10 client.4761 ms_handle_connect on v2:172.21.15.53:6832/2321695931 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3d3fff700 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94d19b0 0x55c1b94d1d80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9925a09a8611e4cb server_cookie=1f65a2a3959b5144 in_seq=0 out_seq=0 2023-09-28T00:23:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3b2ffd700 1 -- 172.21.15.53:0/422446668 <== mds.1 v2:172.21.15.53:6832/2321695931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c1b9385e00 con 0x55c1b94d19b0 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3b2ffd700 10 client.4761 handle_command_reply: tid=0 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 client.4761 shutdown 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 msgr2=0x55c1b94ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 0x55c1b94ce380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8056750 tx=0x7fe3c8025040 comp rx=0 tx=0).stop 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 shutdown_connections 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:6832/2321695931,v1:172.21.15.53:6833/2321695931] conn(0x55c1b94d19b0 0x55c1b94d1d80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c1b94d8bb0 0x55c1b9539190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1b9490e60 0x55c1b94ce380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 --2- 172.21.15.53:0/422446668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c1b94d41e0 0x55c1b9495270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3b2ffd700 0 client.4761 ms_handle_reset on v2:172.21.15.53:6832/2321695931 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.408+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 >> 172.21.15.53:0/422446668 conn(0x55c1b9492260 msgr2=0x55c1b94c46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 shutdown_connections 2023-09-28T00:23:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3e955eb80 1 -- 172.21.15.53:0/422446668 wait complete. 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3e955eb80 20 client.4761 trim_cache size 0 max 16384 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "95448d9d-c293-4b2c-9850-98d8a7632343", 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 1, 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4296, 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-09-28T00:23:20.414 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-09-28T00:23:20.415 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 17.710936823000001, 2023-09-28T00:23:20.415 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 16, 2023-09-28T00:23:20.415 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 25, 2023-09-28T00:23:20.415 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 25, 2023-09-28T00:23:20.415 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 26.057877994999998 2023-09-28T00:23:20.415 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3b8067360 msgr2=0x7fe3b8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3b8067360 0x7fe3b8069810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4159210 tx=0x7fe3c0009250 comp rx=0 tx=0).stop 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 msgr2=0x7fe3d40c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 0x7fe3d40c5bc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40c0220 tx=0x7fe3c8017000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 shutdown_connections 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe3b8067360 0x7fe3b8069810 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d4155750 0x7fe3d414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d406c550 0x7fe3d40c5bc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 --2- 172.21.15.53:0/1571953272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d414f7c0 0x7fe3d4166b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 >> 172.21.15.53:0/1571953272 conn(0x7fe3d4068740 msgr2=0x7fe3d41543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.409+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 shutdown_connections 2023-09-28T00:23:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.410+0000 7fe3d9b9d700 1 -- 172.21.15.53:0/1571953272 wait complete. 2023-09-28T00:23:20.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-28T00:23:20.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.615+0000 7ff04bfff700 1 Processor -- start 2023-09-28T00:23:20.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.616+0000 7ff04bfff700 1 -- start start 2023-09-28T00:23:20.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c0e10 0x7ff04c159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04bfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff04c13ed20 0x7ff04c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04bfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c156040 con 0x7ff04c0c11e0 2023-09-28T00:23:20.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04bfff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c0c6cf0 con 0x7ff04c13ed20 2023-09-28T00:23:20.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04bfff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0c6730 con 0x7ff04c0c0e10 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04a7fc700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff04c0c11e0 0x7ff04c13e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41140/0 (socket says 172.21.15.53:41140) 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04a7fc700 1 -- 172.21.15.53:0/1919327562 learned_addr learned my addr 172.21.15.53:0/1919327562 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04affd700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c0e10 0x7ff04c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.617+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/1919327562 >> v2:172.21.15.118:3300/0 conn(0x7ff04c13ed20 0x7ff04c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff049ffb700 1 -- 172.21.15.53:0/1919327562 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122720059 0 0) 0x7ff04c156040 con 0x7ff04c0c11e0 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff049ffb700 1 -- 172.21.15.53:0/1919327562 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff034003570 con 0x7ff04c0c11e0 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff04b7fe700 1 -- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c0e10 msgr2=0x7ff04c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c0e10 0x7ff04c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff04b7fe700 1 -- 172.21.15.53:0/1919327562 >> v1:172.21.15.53:6789/0 conn(0x7ff04c0c11e0 legacy=0x7ff04c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff04b7fe700 1 -- 172.21.15.53:0/1919327562 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0c6a10 con 0x7ff04c13ed20 2023-09-28T00:23:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff04affd700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c0e10 0x7ff04c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c13ed20 0x7ff04c0cc580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff044009e90 tx=0x7ff044009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718cdcf7e7cc8468 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff049ffb700 1 -- 172.21.15.53:0/1919327562 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400e070 con 0x7ff04c13ed20 2023-09-28T00:23:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff049ffb700 1 -- 172.21.15.53:0/1919327562 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04400bb40 con 0x7ff04c13ed20 2023-09-28T00:23:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.618+0000 7ff049ffb700 1 -- 172.21.15.53:0/1919327562 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044012430 con 0x7ff04c13ed20 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 -- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c13ed20 msgr2=0x7ff04c0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c13ed20 0x7ff04c0cc580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff044009e90 tx=0x7ff044009780 comp rx=0 tx=0).stop 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 -- 172.21.15.53:0/1919327562 shutdown_connections 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c13ed20 0x7ff04c0cc580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 --2- 172.21.15.53:0/1919327562 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c0e10 0x7ff04c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 -- 172.21.15.53:0/1919327562 >> 172.21.15.53:0/1919327562 conn(0x7ff04c06f830 msgr2=0x7ff04c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 -- 172.21.15.53:0/1919327562 shutdown_connections 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.619+0000 7ff04bfff700 1 -- 172.21.15.53:0/1919327562 wait complete. 2023-09-28T00:23:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.620+0000 7ff04bfff700 1 Processor -- start 2023-09-28T00:23:20.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.621+0000 7ff04bfff700 1 -- start start 2023-09-28T00:23:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.621+0000 7ff04bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c0c0e10 0x7ff04c166140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.621+0000 7ff04bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c11e0 0x7ff04c13a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 0x7ff04c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04bfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1593c0 con 0x7ff04c13ed20 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04bfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c15bc80 con 0x7ff04c0c0e10 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04bfff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1582e0 con 0x7ff04c0c11e0 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 0x7ff04c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 0x7ff04c15ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48396/0 (socket says 172.21.15.53:48396) 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 -- 172.21.15.53:0/2801055492 learned_addr learned my addr 172.21.15.53:0/2801055492 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04affd700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c0c0e10 0x7ff04c166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c11e0 0x7ff04c13a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 -- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c11e0 msgr2=0x7ff04c13a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c11e0 0x7ff04c13a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 -- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c0c0e10 msgr2=0x7ff04c166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c0c0e10 0x7ff04c166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 -- 172.21.15.53:0/2801055492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c009420 con 0x7ff04c13ed20 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.622+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 0x7ff04c15ae80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff044013000 tx=0x7ff044019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.623+0000 7ff032ffd700 1 -- 172.21.15.53:0/2801055492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044012ce0 con 0x7ff04c13ed20 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.623+0000 7ff032ffd700 1 -- 172.21.15.53:0/2801055492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044021070 con 0x7ff04c13ed20 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.623+0000 7ff032ffd700 1 -- 172.21.15.53:0/2801055492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044026680 con 0x7ff04c13ed20 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.623+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff044009a20 con 0x7ff04c13ed20 2023-09-28T00:23:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.623+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c158b20 con 0x7ff04c13ed20 2023-09-28T00:23:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.625+0000 7ff032ffd700 1 -- 172.21.15.53:0/2801055492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff044023030 con 0x7ff04c13ed20 2023-09-28T00:23:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.626+0000 7ff032ffd700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff038067330 0x7ff0380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.626+0000 7ff032ffd700 1 -- 172.21.15.53:0/2801055492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff044086ce0 con 0x7ff04c13ed20 2023-09-28T00:23:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.626+0000 7ff04affd700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff038067330 0x7ff0380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.627+0000 7ff04affd700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff038067330 0x7ff0380697e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009f40 tx=0x7ff03c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.628+0000 7ff05feb1b80 1 Processor -- start 2023-09-28T00:23:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.628+0000 7ff05feb1b80 1 -- start start 2023-09-28T00:23:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.628+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e542799c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.628+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e5427c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e5427cbb0 0x563e542722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e5418da70 con 0x563e54234e60 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e5418b270 con 0x563e5427cbb0 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e54187060 con 0x563e542781e0 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e5427c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e5427c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48406/0 (socket says 172.21.15.53:48406) 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 -- 172.21.15.53:0/3991275541 learned_addr learned my addr 172.21.15.53:0/3991275541 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e5427cbb0 0x563e542722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04affd700 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e542799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 -- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 msgr2=0x563e542799c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e542799c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 -- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e5427cbb0 msgr2=0x563e542722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e5427cbb0 0x563e542722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 -- 172.21.15.53:0/3991275541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e54021270 con 0x563e54234e60 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.629+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e5427c670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0400017c0 tx=0x7ff040009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ca6415f5b8e6bb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff02bfff700 1 -- 172.21.15.53:0/3991275541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040005b10 con 0x563e54234e60 2023-09-28T00:23:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff02bfff700 1 -- 172.21.15.53:0/3991275541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040005c70 con 0x563e54234e60 2023-09-28T00:23:20.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff02bfff700 1 -- 172.21.15.53:0/3991275541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400070d0 con 0x563e54234e60 2023-09-28T00:23:20.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3991275541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 msgr2=0x563e5427c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e5427c670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0400017c0 tx=0x7ff040009040 comp rx=0 tx=0).stop 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3991275541 shutdown_connections 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e542799c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e5427cbb0 0x563e542722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3991275541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e5427c670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.630+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3991275541 >> 172.21.15.53:0/3991275541 conn(0x563e54236260 msgr2=0x563e54236630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.631+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3991275541 shutdown_connections 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.631+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3991275541 wait complete. 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.631+0000 7ff05feb1b80 1 -- start start 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.632+0000 7ff05feb1b80 1 Processor -- start 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.632+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54234e60 0x563e5427d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.632+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 0x563e5426e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e5427cbb0 0x563e5427c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e54132890 con 0x563e542781e0 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e5414dea0 con 0x563e54234e60 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e54009e30 con 0x563e5427cbb0 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff05feb1b80 10 client.0 _ll_register_callbacks cb 0x563e541fa020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 0x563e5426e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04affd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54234e60 0x563e5427d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 0x563e5426e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48408/0 (socket says 172.21.15.53:48408) 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 -- 172.21.15.53:0/2226458215 learned_addr learned my addr 172.21.15.53:0/2226458215 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e5427cbb0 0x563e5427c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 -- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e5427cbb0 msgr2=0x563e5427c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e5427cbb0 0x563e5427c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 -- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54234e60 msgr2=0x563e5427d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54234e60 0x563e5427d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 -- 172.21.15.53:0/2226458215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff034003570 con 0x563e542781e0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 0x563e5426e180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff040001e60 tx=0x7ff040015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cab870f2fcd559 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.633+0000 7ff0297fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff0297fa700 1 -- 172.21.15.53:0/2226458215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040007150 con 0x563e542781e0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff0297fa700 1 -- 172.21.15.53:0/2226458215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff04000f690 con 0x563e542781e0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e5422b940 con 0x563e542781e0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff0297fa700 1 -- 172.21.15.53:0/2226458215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff04000fa60 con 0x563e542781e0 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 10 client.4773 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:20.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563e53fc3fe0 con 0x563e542781e0 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff0297fa700 1 -- 172.21.15.53:0/2226458215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e5422b940 con 0x563e542781e0 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff0297fa700 1 -- 172.21.15.53:0/2226458215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7ff040012070 con 0x563e542781e0 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 10 client.4773 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 10 client.4773 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 20 client.4773 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427de40 0x563e5428bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 4 client.4773 mds_command: new command op to 4299 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.634+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 --> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e54208870 con 0x563e5427de40 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.635+0000 7ff04affd700 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427de40 0x563e5428bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.635+0000 7ff04affd700 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427de40 0x563e5428bc60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93669025976b3e14 server_cookie=dd1d7e578230bf17 in_seq=0 out_seq=0 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.635+0000 7ff0297fa700 10 client.4773 ms_handle_connect on v2:172.21.15.53:6834/4226289239 2023-09-28T00:23:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff0297fa700 1 -- 172.21.15.53:0/2226458215 <== mds.0 v2:172.21.15.53:6834/4226289239 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563e54208870 con 0x563e5427de40 2023-09-28T00:23:20.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff0297fa700 10 client.4773 handle_command_reply: tid=0 2023-09-28T00:23:20.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 client.4773 shutdown 2023-09-28T00:23:20.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 msgr2=0x563e5426e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 0x563e5426e180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff040001e60 tx=0x7ff040015000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 shutdown_connections 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427de40 0x563e5428bc60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e5427cbb0 0x563e5427c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54234e60 0x563e5427d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/2226458215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e542781e0 0x563e5426e180 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 >> 172.21.15.53:0/2226458215 conn(0x563e54236260 msgr2=0x563e542785b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff0297fa700 0 client.4773 ms_handle_reset on v2:172.21.15.53:6834/4226289239 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 shutdown_connections 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.636+0000 7ff05feb1b80 1 -- 172.21.15.53:0/2226458215 wait complete. 2023-09-28T00:23:20.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.637+0000 7ff05feb1b80 20 client.4773 trim_cache size 0 max 16384 2023-09-28T00:23:20.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.654+0000 7ff05feb1b80 1 Processor -- start 2023-09-28T00:23:20.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.654+0000 7ff05feb1b80 1 -- start start 2023-09-28T00:23:20.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 0x563e5422d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e54234e60 0x563e5422d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e542781e0 0x563e5426a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e54239980 con 0x563e54236260 2023-09-28T00:23:20.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e54288850 con 0x563e542781e0 2023-09-28T00:23:20.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e542691f0 con 0x563e54234e60 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 0x563e5422d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 0x563e5422d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48414/0 (socket says 172.21.15.53:48414) 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 -- 172.21.15.53:0/784307483 learned_addr learned my addr 172.21.15.53:0/784307483 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e542781e0 0x563e5426a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e54234e60 0x563e5422d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 -- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e54234e60 msgr2=0x563e5422d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e54234e60 0x563e5422d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 -- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e542781e0 msgr2=0x563e5426a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e542781e0 0x563e5426a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.655+0000 7ff04affd700 1 -- 172.21.15.53:0/784307483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e54155780 con 0x563e54236260 2023-09-28T00:23:20.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.656+0000 7ff04affd700 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 0x563e5422d400 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x563e5427c6f0 tx=0x7ff03c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799223866c6ddd53 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.656+0000 7ff030ff9700 1 -- 172.21.15.53:0/784307483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0244d0 con 0x563e54236260 2023-09-28T00:23:20.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.656+0000 7ff030ff9700 1 -- 172.21.15.53:0/784307483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c024630 con 0x563e54236260 2023-09-28T00:23:20.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.656+0000 7ff030ff9700 1 -- 172.21.15.53:0/784307483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0249b0 con 0x563e54236260 2023-09-28T00:23:20.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.656+0000 7ff05feb1b80 1 -- 172.21.15.53:0/784307483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 msgr2=0x563e5422d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.656+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 0x563e5422d400 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x563e5427c6f0 tx=0x7ff03c016000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 -- 172.21.15.53:0/784307483 shutdown_connections 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e542781e0 0x563e5426a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54236260 0x563e5422d400 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/784307483 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e54234e60 0x563e5422d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 -- 172.21.15.53:0/784307483 >> 172.21.15.53:0/784307483 conn(0x563e5423a180 msgr2=0x563e54238220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 -- 172.21.15.53:0/784307483 shutdown_connections 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 -- 172.21.15.53:0/784307483 wait complete. 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 -- start start 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.657+0000 7ff05feb1b80 1 Processor -- start 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e542e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54236260 0x563e542d8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e54275f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e542deeb0 con 0x563e54234e60 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e5427c230 con 0x563e54236260 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e54275a10 con 0x563e542781e0 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.658+0000 7ff05feb1b80 10 client.0 _ll_register_callbacks cb 0x563e541fa020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e542e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e542e2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48428/0 (socket says 172.21.15.53:48428) 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 -- 172.21.15.53:0/3943074886 learned_addr learned my addr 172.21.15.53:0/3943074886 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54236260 0x563e542d8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e54275f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 -- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 msgr2=0x563e54275f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e54275f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 -- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54236260 msgr2=0x563e542d8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54236260 0x563e542d8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 -- 172.21.15.53:0/3943074886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c014600 con 0x563e54234e60 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04b7fe700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e54275f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54236260 0x563e542d8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff04affd700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e542e2af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff03c011dc0 tx=0x7ff03c026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9842e76dbfc69786 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff0297fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff0297fa700 1 -- 172.21.15.53:0/3943074886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c005ce0 con 0x563e54234e60 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff0297fa700 1 -- 172.21.15.53:0/3943074886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff03c029040 con 0x563e54234e60 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.659+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e54278ff0 con 0x563e54234e60 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff0297fa700 1 -- 172.21.15.53:0/3943074886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff03c041ea0 con 0x563e54234e60 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 10 client.4779 fetch_fsmap learned FSMap version 16 2023-09-28T00:23:20.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563e5413c470 con 0x563e54234e60 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff0297fa700 1 -- 172.21.15.53:0/3943074886 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e54278ff0 con 0x563e54234e60 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff0297fa700 1 -- 172.21.15.53:0/3943074886 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 16) v1 ==== 4238+0+0 (secure 0 0 0) 0x7ff03c006040 con 0x563e54234e60 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 10 client.4779 fetch_fsmap finished waiting for FSMap version 16 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 10 client.4779 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 20 client.4779 populate_metadata read hostname 'smithi053' 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427cbb0 0x563e54232ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 4 client.4779 mds_command: new command op to 4299 tid=0[{"prefix": "status"}] 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 --> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ff040005c70 con 0x563e5427cbb0 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.660+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427cbb0 0x563e54232ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff04a7fc700 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427cbb0 0x563e54232ad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdfffeda8b6cde74 server_cookie=aa192beb0cc2ae99 in_seq=0 out_seq=0 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff0297fa700 10 client.4779 ms_handle_connect on v2:172.21.15.53:6834/4226289239 2023-09-28T00:23:20.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff0297fa700 1 -- 172.21.15.53:0/3943074886 <== mds.0 v2:172.21.15.53:6834/4226289239 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7ff040005c70 con 0x563e5427cbb0 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff0297fa700 10 client.4779 handle_command_reply: tid=0 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 client.4779 shutdown 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 msgr2=0x563e542e2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e542e2af0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff03c011dc0 tx=0x7ff03c026000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 shutdown_connections 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:6834/4226289239,v1:172.21.15.53:6836/4226289239] conn(0x563e5427cbb0 0x563e54232ad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x563e542781e0 0x563e54275f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e54234e60 0x563e542e2af0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 --2- 172.21.15.53:0/3943074886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563e54236260 0x563e542d8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff0297fa700 0 client.4779 ms_handle_reset on v2:172.21.15.53:6834/4226289239 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 >> 172.21.15.53:0/3943074886 conn(0x563e5423a180 msgr2=0x563e5426d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 shutdown_connections 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 1 -- 172.21.15.53:0/3943074886 wait complete. 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.661+0000 7ff05feb1b80 20 client.4779 trim_cache size 0 max 16384 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "95448d9d-c293-4b2c-9850-98d8a7632343", 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4299, 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-09-28T00:23:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 20.977245667999998, 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 16, 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 25, 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 25, 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 26.306535214 2023-09-28T00:23:20.669 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff038067330 msgr2=0x7ff0380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff038067330 0x7ff0380697e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009f40 tx=0x7ff03c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 msgr2=0x7ff04c15ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 0x7ff04c15ae80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff044013000 tx=0x7ff044019000 comp rx=0 tx=0).stop 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 shutdown_connections 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ff038067330 0x7ff0380697e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04c13ed20 0x7ff04c15ae80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff04c0c0e10 0x7ff04c166140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 --2- 172.21.15.53:0/2801055492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff04c0c11e0 0x7ff04c13a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:20.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 >> 172.21.15.53:0/2801055492 conn(0x7ff04c06f830 msgr2=0x7ff04c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:20.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 shutdown_connections 2023-09-28T00:23:20.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:20.662+0000 7ff04bfff700 1 -- 172.21.15.53:0/2801055492 wait complete. 2023-09-28T00:23:20.679 INFO:teuthology.run_tasks:Running task kclient... 2023-09-28T00:23:20.700 INFO:tasks.kclient:Mounting kernel clients... 2023-09-28T00:23:20.700 INFO:tasks.kclient:config is {'client.0': {}} 2023-09-28T00:23:20.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:20.701 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-09-28T00:23:20.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:20.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-09-28T00:23:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2023-09-28T00:23:20.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:23:20.845 INFO:tasks.kclient:client.0 config is {} 2023-09-28T00:23:20.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-28T00:23:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.032+0000 7ffb5919d700 1 Processor -- start 2023-09-28T00:23:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.032+0000 7ffb5919d700 1 -- start start 2023-09-28T00:23:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5919d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb54155d00 0x7ffb540c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5919d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb540c0bc0 0x7ffb54152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5919d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb540c6c10 con 0x7ffb54156680 2023-09-28T00:23:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5919d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540c52b0 con 0x7ffb540c0bc0 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5919d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c5d20 con 0x7ffb54155d00 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5899c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb540c0bc0 0x7ffb54152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb54155d00 0x7ffb540c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5899c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb540c0bc0 0x7ffb54152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48430/0 (socket says 172.21.15.53:48430) 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb5899c700 1 -- 172.21.15.53:0/173453257 learned_addr learned my addr 172.21.15.53:0/173453257 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.033+0000 7ffb537fe700 1 --1- 172.21.15.53:0/173453257 >> v1:172.21.15.53:6789/0 conn(0x7ffb54156680 0x7ffb540c04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41152/0 (socket says 172.21.15.53:41152) 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb5899c700 1 -- 172.21.15.53:0/173453257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb54155d00 msgr2=0x7ffb540c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb5899c700 1 --2- 172.21.15.53:0/173453257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb54155d00 0x7ffb540c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb5899c700 1 -- 172.21.15.53:0/173453257 >> v1:172.21.15.53:6789/0 conn(0x7ffb54156680 legacy=0x7ffb540c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb5899c700 1 -- 172.21.15.53:0/173453257 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540c6000 con 0x7ffb540c0bc0 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb52ffd700 1 -- 172.21.15.53:0/173453257 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535667347 0 0) 0x7ffb540c6c10 con 0x7ffb54156680 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb5899c700 1 --2- 172.21.15.53:0/173453257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540c0bc0 0x7ffb54152580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d1a0 tx=0x7ffb4c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bba48a957081b97 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb52ffd700 1 -- 172.21.15.53:0/173453257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c010070 con 0x7ffb540c0bc0 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb52ffd700 1 -- 172.21.15.53:0/173453257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00b0d0 con 0x7ffb540c0bc0 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.034+0000 7ffb52ffd700 1 -- 172.21.15.53:0/173453257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00dea0 con 0x7ffb540c0bc0 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 -- 172.21.15.53:0/173453257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540c0bc0 msgr2=0x7ffb54152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 --2- 172.21.15.53:0/173453257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540c0bc0 0x7ffb54152580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d1a0 tx=0x7ffb4c00ba50 comp rx=0 tx=0).stop 2023-09-28T00:23:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 -- 172.21.15.53:0/173453257 shutdown_connections 2023-09-28T00:23:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 --2- 172.21.15.53:0/173453257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540c0bc0 0x7ffb54152580 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 --2- 172.21.15.53:0/173453257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb54155d00 0x7ffb540c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 -- 172.21.15.53:0/173453257 >> 172.21.15.53:0/173453257 conn(0x7ffb54067630 msgr2=0x7ffb54067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 -- 172.21.15.53:0/173453257 shutdown_connections 2023-09-28T00:23:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.035+0000 7ffb5919d700 1 -- 172.21.15.53:0/173453257 wait complete. 2023-09-28T00:23:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.036+0000 7ffb5919d700 1 Processor -- start 2023-09-28T00:23:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.036+0000 7ffb5919d700 1 -- start start 2023-09-28T00:23:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.037+0000 7ffb5919d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb540c0bc0 0x7ffb541659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.037+0000 7ffb5919d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 0x7ffb5406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.037+0000 7ffb5919d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb54156680 0x7ffb540ba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.037+0000 7ffb5919d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540ba460 con 0x7ffb54155d00 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.037+0000 7ffb5919d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54152b80 con 0x7ffb54156680 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.037+0000 7ffb5919d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54152df0 con 0x7ffb540c0bc0 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 0x7ffb5406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 0x7ffb5406ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48442/0 (socket says 172.21.15.53:48442) 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 -- 172.21.15.53:0/2680259319 learned_addr learned my addr 172.21.15.53:0/2680259319 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb5899c700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb54156680 0x7ffb540ba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb53fff700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb540c0bc0 0x7ffb541659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 -- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb540c0bc0 msgr2=0x7ffb541659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb540c0bc0 0x7ffb541659f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 -- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb54156680 msgr2=0x7ffb540ba8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb54156680 0x7ffb540ba8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 -- 172.21.15.53:0/2680259319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c00bcf0 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb537fe700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 0x7ffb5406ed50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c540 tx=0x7ffb4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48005a70 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48005bf0 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480070d0 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.038+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb541530d0 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.039+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54153690 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.040+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540ba610 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.041+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffb48007480 con 0x7ffb54155d00 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.042+0000 7ffb3bfff700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ffb40067330 0x7ffb400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:21.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.042+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb48083fe0 con 0x7ffb54155d00 2023-09-28T00:23:21.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.042+0000 7ffb53fff700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ffb40067330 0x7ffb400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:21.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.043+0000 7ffb53fff700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ffb40067330 0x7ffb400697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009db0 tx=0x7ffb440091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:21.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.046+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ffb540ba610 con 0x7ffb54155d00 2023-09-28T00:23:21.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.292+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb540ba610 con 0x7ffb54155d00 2023-09-28T00:23:21.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.293+0000 7ffb3bfff700 1 -- 172.21.15.53:0/2680259319 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb540ba610 con 0x7ffb54155d00 2023-09-28T00:23:21.293 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-28T00:23:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ffb40067330 msgr2=0x7ffb400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ffb40067330 0x7ffb400697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009db0 tx=0x7ffb440091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 msgr2=0x7ffb5406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 0x7ffb5406ed50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c540 tx=0x7ffb4800c850 comp rx=0 tx=0).stop 2023-09-28T00:23:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 shutdown_connections 2023-09-28T00:23:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7ffb40067330 0x7ffb400697e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb540c0bc0 0x7ffb541659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb54156680 0x7ffb540ba8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 --2- 172.21.15.53:0/2680259319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54155d00 0x7ffb5406ed50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 >> 172.21.15.53:0/2680259319 conn(0x7ffb54067630 msgr2=0x7ffb540c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 shutdown_connections 2023-09-28T00:23:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:21.295+0000 7ffb5919d700 1 -- 172.21.15.53:0/2680259319 wait complete. 2023-09-28T00:23:21.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-28T00:23:21.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-28T00:23:21.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:21.314 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-09-28T00:23:21.351 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-28T00:23:21.351 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-28T00:23:21.351 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-09-28T00:23:21.351 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-09-28T00:23:21.351 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-28T00:23:21.352 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42306sec preferred_lft 42306sec 2023-09-28T00:23:21.353 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-09-28T00:23:21.353 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-09-28T00:23:21.353 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T00:23:21.353 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-09-28T00:23:21.353 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-09-28T00:23:21.353 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-28T00:23:21.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-28T00:23:21.354 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-09-28T00:23:21.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:21.815 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-28T00:23:21.881 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-09-28T00:23:21.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:21.885 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-09-28T00:23:21.939 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-09-28T00:23:21.939 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-28T00:23:21.939 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-28T00:23:21.940 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-28T00:23:21.940 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-28T00:23:21.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:21.941 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-09-28T00:23:21.941 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-09-28T00:23:21.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-28T00:23:21.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-28T00:23:21.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-28T00:23:21.942 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-09-28T00:23:22.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:22.624 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-09-28T00:23:22.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:22.662 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-09-28T00:23:22.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:22.739 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-09-28T00:23:22.739 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-09-28T00:23:22.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-28T00:23:22.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-28T00:23:22.739 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-09-28T00:23:22.909 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-28T00:23:22.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:22.909 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-09-28T00:23:22.909 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-09-28T00:23:22.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-28T00:23:22.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-28T00:23:22.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-28T00:23:22.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-28T00:23:22.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-28T00:23:22.910 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-09-28T00:23:23.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:23:23.164 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-09-28T00:23:23.164 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-09-28T00:23:23.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-09-28T00:23:23.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2023-09-28T00:23:23.164 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-09-28T00:23:23.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-28T00:23:23.326 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-28T00:23:23.363 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-28T00:23:23.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-28T00:23:23.363 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-28T00:23:23.439 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/kclient.py", line 112, in task kernel_mount.mount(mntopts=client_config.get('mntopts', [])) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 54, in mount retval = self._run_mount_cmd(mntopts, check_status) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 69, in _run_mount_cmd mount_cmd = self._get_mount_cmd(mntopts) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 118, in _get_mount_cmd stx_opt = self._make_mount_cmd_old_or_new_style() File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 91, in _make_mount_cmd_old_or_new_style assert(self.cephfs_mntpt) AssertionError 2023-09-28T00:23:23.502 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cda4fe37049048718c7813cf59701877 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/kclient.py", line 112, in task kernel_mount.mount(mntopts=client_config.get('mntopts', [])) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 54, in mount retval = self._run_mount_cmd(mntopts, check_status) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 69, in _run_mount_cmd mount_cmd = self._get_mount_cmd(mntopts) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 118, in _get_mount_cmd stx_opt = self._make_mount_cmd_old_or_new_style() File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 91, in _make_mount_cmd_old_or_new_style assert(self.cephfs_mntpt) AssertionError 2023-09-28T00:23:23.504 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-28T00:23:23.514 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-28T00:23:23.571 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-28T00:23:23.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:23.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.768+0000 7f7ccaf9d700 1 Processor -- start 2023-09-28T00:23:23.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.768+0000 7f7ccaf9d700 1 -- start start 2023-09-28T00:23:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.769+0000 7f7ccaf9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7cc4156680 0x7f7cc40c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7ccaf9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7cc41560d0 0x7f7cc40c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7ccaf9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc40c6c10 con 0x7f7cc4155d00 2023-09-28T00:23:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7ccaf9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40c5d20 con 0x7f7cc41560d0 2023-09-28T00:23:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7ccaf9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40c6000 con 0x7f7cc4156680 2023-09-28T00:23:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7cc41560d0 0x7f7cc40c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7cc41560d0 0x7f7cc40c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48446/0 (socket says 172.21.15.53:48446) 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 -- 172.21.15.53:0/817261506 learned_addr learned my addr 172.21.15.53:0/817261506 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cc9f9b700 1 --1- 172.21.15.53:0/817261506 >> v1:172.21.15.118:6789/0 conn(0x7f7cc4155d00 0x7f7cc40c4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:36724/0 (socket says 172.21.15.53:36724) 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cc979a700 1 --2- 172.21.15.53:0/817261506 >> v2:172.21.15.118:3300/0 conn(0x7f7cc4156680 0x7f7cc40c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cc8f99700 1 -- 172.21.15.53:0/817261506 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133827173 0 0) 0x7f7cc40c6c10 con 0x7f7cc4155d00 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cc8f99700 1 -- 172.21.15.53:0/817261506 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb0003570 con 0x7f7cc4155d00 2023-09-28T00:23:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 -- 172.21.15.53:0/817261506 >> v2:172.21.15.118:3300/0 conn(0x7f7cc4156680 msgr2=0x7f7cc40c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 --2- 172.21.15.53:0/817261506 >> v2:172.21.15.118:3300/0 conn(0x7f7cc4156680 0x7f7cc40c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 -- 172.21.15.53:0/817261506 >> v1:172.21.15.118:6789/0 conn(0x7f7cc4155d00 legacy=0x7f7cc40c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cca79c700 1 -- 172.21.15.53:0/817261506 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc40c62e0 con 0x7f7cc41560d0 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.770+0000 7f7cc979a700 1 --2- 172.21.15.53:0/817261506 >> v2:172.21.15.118:3300/0 conn(0x7f7cc4156680 0x7f7cc40c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.771+0000 7f7cca79c700 1 --2- 172.21.15.53:0/817261506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc41560d0 0x7f7cc40c09f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40c02b0 tx=0x7f7cbc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5d6e16d6596183 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.771+0000 7f7cc8f99700 1 -- 172.21.15.53:0/817261506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc010070 con 0x7f7cc41560d0 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.771+0000 7f7cc8f99700 1 -- 172.21.15.53:0/817261506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc00ddc0 con 0x7f7cc41560d0 2023-09-28T00:23:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.771+0000 7f7cc8f99700 1 -- 172.21.15.53:0/817261506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00b320 con 0x7f7cc41560d0 2023-09-28T00:23:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.771+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/817261506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc41560d0 msgr2=0x7f7cc40c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.771+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/817261506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc41560d0 0x7f7cc40c09f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40c02b0 tx=0x7f7cbc00ba50 comp rx=0 tx=0).stop 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.772+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/817261506 shutdown_connections 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.772+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/817261506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc41560d0 0x7f7cc40c09f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.772+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/817261506 >> v2:172.21.15.118:3300/0 conn(0x7f7cc4156680 0x7f7cc40c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.772+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/817261506 >> 172.21.15.53:0/817261506 conn(0x7f7cc4067630 msgr2=0x7f7cc4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.772+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/817261506 shutdown_connections 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.772+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/817261506 wait complete. 2023-09-28T00:23:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.773+0000 7f7ccaf9d700 1 Processor -- start 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.773+0000 7f7ccaf9d700 1 -- start start 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7ccaf9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 0x7f7cc406db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7ccaf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cc41560d0 0x7f7cc40b9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7ccaf9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cc4156680 0x7f7cc40b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7ccaf9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4165ad0 con 0x7f7cc4155d00 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7ccaf9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40c29a0 con 0x7f7cc4156680 2023-09-28T00:23:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7ccaf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4165810 con 0x7f7cc41560d0 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7cc9f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 0x7f7cc406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7cc9f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 0x7f7cc406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48458/0 (socket says 172.21.15.53:48458) 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7cc9f9b700 1 -- 172.21.15.53:0/3727728600 learned_addr learned my addr 172.21.15.53:0/3727728600 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.774+0000 7f7cc979a700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cc41560d0 0x7f7cc40b9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cca79c700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cc4156680 0x7f7cc40b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cc9f9b700 1 -- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cc41560d0 msgr2=0x7f7cc40b9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cc9f9b700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cc41560d0 0x7f7cc40b9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cc9f9b700 1 -- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cc4156680 msgr2=0x7f7cc40b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cc9f9b700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cc4156680 0x7f7cc40b9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cc9f9b700 1 -- 172.21.15.53:0/3727728600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4009420 con 0x7f7cc4155d00 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cc9f9b700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 0x7f7cc406db10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c5c0 tx=0x7f7cc0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0005a70 con 0x7f7cc4155d00 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc0005bf0 con 0x7f7cc4155d00 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cbc00bcf0 con 0x7f7cc4155d00 2023-09-28T00:23:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00070d0 con 0x7f7cc4155d00 2023-09-28T00:23:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.775+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc40c2350 con 0x7f7cc4155d00 2023-09-28T00:23:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.777+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc404c3c0 con 0x7f7cc4155d00 2023-09-28T00:23:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.777+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7cc00074c0 con 0x7f7cc4155d00 2023-09-28T00:23:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.778+0000 7f7cb9ffb700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7ca8067360 0x7f7ca8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.778+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cc0084000 con 0x7f7cc4155d00 2023-09-28T00:23:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.779+0000 7f7cc979a700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7ca8067360 0x7f7ca8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.779+0000 7f7cc979a700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7ca8067360 0x7f7ca8069810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4152e40 tx=0x7f7cb40091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.783+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7cc0050f00 con 0x7f7cc4155d00 2023-09-28T00:23:23.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.987+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cc40bed70 con 0x7f7cc4155d00 2023-09-28T00:23:23.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.988+0000 7f7cb9ffb700 1 -- 172.21.15.53:0/3727728600 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f7cc0017090 con 0x7f7cc4155d00 2023-09-28T00:23:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:23.988 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:23.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7ca8067360 msgr2=0x7f7ca8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:23.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7ca8067360 0x7f7ca8069810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4152e40 tx=0x7f7cb40091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 msgr2=0x7f7cc406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:23.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 0x7f7cc406db10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c5c0 tx=0x7f7cc0007e00 comp rx=0 tx=0).stop 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 shutdown_connections 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7ca8067360 0x7f7ca8069810 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cc4156680 0x7f7cc40b9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc4155d00 0x7f7cc406db10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 --2- 172.21.15.53:0/3727728600 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cc41560d0 0x7f7cc40b9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.990+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 >> 172.21.15.53:0/3727728600 conn(0x7f7cc4067630 msgr2=0x7f7cc40c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.991+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 shutdown_connections 2023-09-28T00:23:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:23.991+0000 7f7ccaf9d700 1 -- 172.21.15.53:0/3727728600 wait complete. 2023-09-28T00:23:24.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T00:23:24.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.195+0000 7f6bdc9fe700 1 Processor -- start 2023-09-28T00:23:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.195+0000 7f6bdc9fe700 1 -- start start 2023-09-28T00:23:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bdc9fe700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6bd8155d00 0x7f6bd80c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bdc9fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6bd8156680 0x7f6bd80c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bdc9fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd81560d0 0x7f6bd80c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bdc9fe700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd80c6c10 con 0x7f6bd8155d00 2023-09-28T00:23:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bdc9fe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd80c52b0 con 0x7f6bd8156680 2023-09-28T00:23:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bdc9fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80c5d20 con 0x7f6bd81560d0 2023-09-28T00:23:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bd6d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6bd8155d00 0x7f6bd80c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bd6d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6bd8155d00 0x7f6bd80c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48466/0 (socket says 172.21.15.53:48466) 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bd6d9d700 1 -- 172.21.15.53:0/2398243251 learned_addr learned my addr 172.21.15.53:0/2398243251 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bd659c700 1 --2- 172.21.15.53:0/2398243251 >> v2:172.21.15.118:3300/0 conn(0x7f6bd8156680 0x7f6bd80c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.197+0000 7f6bd759e700 1 --2- 172.21.15.53:0/2398243251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd81560d0 0x7f6bd80c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd6d9d700 1 -- 172.21.15.53:0/2398243251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd81560d0 msgr2=0x7f6bd80c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd6d9d700 1 --2- 172.21.15.53:0/2398243251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd81560d0 0x7f6bd80c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd6d9d700 1 -- 172.21.15.53:0/2398243251 >> v2:172.21.15.118:3300/0 conn(0x7f6bd8156680 msgr2=0x7f6bd80c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd6d9d700 1 --2- 172.21.15.53:0/2398243251 >> v2:172.21.15.118:3300/0 conn(0x7f6bd8156680 0x7f6bd80c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd6d9d700 1 -- 172.21.15.53:0/2398243251 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80c6000 con 0x7f6bd8155d00 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd659c700 1 --2- 172.21.15.53:0/2398243251 >> v2:172.21.15.118:3300/0 conn(0x7f6bd8156680 0x7f6bd80c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd6d9d700 1 --2- 172.21.15.53:0/2398243251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8155d00 0x7f6bd80c4d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80099b0 tx=0x7f6bc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb8189a81d09875 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd5d9b700 1 -- 172.21.15.53:0/2398243251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800b6d0 con 0x7f6bd8155d00 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd5d9b700 1 -- 172.21.15.53:0/2398243251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc800b830 con 0x7f6bd8155d00 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.198+0000 7f6bd5d9b700 1 -- 172.21.15.53:0/2398243251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800bbd0 con 0x7f6bd8155d00 2023-09-28T00:23:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/2398243251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8155d00 msgr2=0x7f6bd80c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/2398243251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8155d00 0x7f6bd80c4d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80099b0 tx=0x7f6bc8009250 comp rx=0 tx=0).stop 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/2398243251 shutdown_connections 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/2398243251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd81560d0 0x7f6bd80c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/2398243251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd8155d00 0x7f6bd80c4d70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/2398243251 >> v2:172.21.15.118:3300/0 conn(0x7f6bd8156680 0x7f6bd80c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/2398243251 >> 172.21.15.53:0/2398243251 conn(0x7f6bd8067630 msgr2=0x7f6bd8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/2398243251 shutdown_connections 2023-09-28T00:23:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.199+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/2398243251 wait complete. 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.200+0000 7f6bdc9fe700 1 Processor -- start 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.200+0000 7f6bdc9fe700 1 -- start start 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.201+0000 7f6bdc9fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd8155d00 0x7f6bd8166270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.201+0000 7f6bdc9fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 0x7f6bd80bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.201+0000 7f6bdc9fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd8156680 0x7f6bd814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.201+0000 7f6bdc9fe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80bc300 con 0x7f6bd81560d0 2023-09-28T00:23:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.201+0000 7f6bdc9fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81667b0 con 0x7f6bd8156680 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.201+0000 7f6bdc9fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80bbb10 con 0x7f6bd8155d00 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 0x7f6bd80bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 0x7f6bd80bcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48472/0 (socket says 172.21.15.53:48472) 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 -- 172.21.15.53:0/1708203912 learned_addr learned my addr 172.21.15.53:0/1708203912 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd759e700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd8156680 0x7f6bd814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd6d9d700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd8155d00 0x7f6bd8166270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 -- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd8155d00 msgr2=0x7f6bd8166270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd8155d00 0x7f6bd8166270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 -- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd8156680 msgr2=0x7f6bd814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd8156680 0x7f6bd814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 -- 172.21.15.53:0/1708203912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc009420 con 0x7f6bd81560d0 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd759e700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd8156680 0x7f6bd814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.202+0000 7f6bd659c700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 0x7f6bd80bcb60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00ecb0 tx=0x7f6bcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.203+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00c8e0 con 0x7f6bd81560d0 2023-09-28T00:23:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.203+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00ca40 con 0x7f6bd81560d0 2023-09-28T00:23:24.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.203+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80094f0 con 0x7f6bd81560d0 2023-09-28T00:23:24.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.203+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00cde0 con 0x7f6bd81560d0 2023-09-28T00:23:24.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.203+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd80bb5e0 con 0x7f6bd81560d0 2023-09-28T00:23:24.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.204+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd804c3c0 con 0x7f6bd81560d0 2023-09-28T00:23:24.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.205+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6bcc013680 con 0x7f6bd81560d0 2023-09-28T00:23:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.206+0000 7f6bbeffd700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6bc4067330 0x7f6bc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.206+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bcc084f20 con 0x7f6bd81560d0 2023-09-28T00:23:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.206+0000 7f6bd6d9d700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6bc4067330 0x7f6bc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.207+0000 7f6bd6d9d700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6bc4067330 0x7f6bc40697e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80099b0 tx=0x7f6bc8017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:24.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.210+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6bcc051e20 con 0x7f6bd81560d0 2023-09-28T00:23:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.406+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bd806d5e0 con 0x7f6bc4067330 2023-09-28T00:23:24.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.415+0000 7f6bbeffd700 1 -- 172.21.15.53:0/1708203912 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284734 (secure 0 0 0) 0x7f6bd806d5e0 con 0x7f6bc4067330 2023-09-28T00:23:24.419 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6bc4067330 msgr2=0x7f6bc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6bc4067330 0x7f6bc40697e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80099b0 tx=0x7f6bc8017000 comp rx=0 tx=0).stop 2023-09-28T00:23:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 msgr2=0x7f6bd80bcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 0x7f6bd80bcb60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00ecb0 tx=0x7f6bcc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 shutdown_connections 2023-09-28T00:23:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f6bc4067330 0x7f6bc40697e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bd8155d00 0x7f6bd8166270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bd8156680 0x7f6bd814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 --2- 172.21.15.53:0/1708203912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bd81560d0 0x7f6bd80bcb60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 >> 172.21.15.53:0/1708203912 conn(0x7f6bd8067630 msgr2=0x7f6bd815b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:24.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 shutdown_connections 2023-09-28T00:23:24.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.419+0000 7f6bdc9fe700 1 -- 172.21.15.53:0/1708203912 wait complete. 2023-09-28T00:23:24.424 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:24.437 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-09-28T00:23:23.107695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83496,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80000,"kb_avail":754891224,"statfs":{"total":773094113280,"available":773008613376,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81920000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003156"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711001+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.711001+0000","last_peered":"2023-09-28T00:22:59.711001+0000","last_clean":"2023-09-28T00:22:59.711001+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.711001+0000","last_undegraded":"2023-09-28T00:22:59.711001+0000","last_fullsized":"2023-09-28T00:22:59.711001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706544+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.706544+0000","last_peered":"2023-09-28T00:22:59.706544+0000","last_clean":"2023-09-28T00:22:59.706544+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.706544+0000","last_undegraded":"2023-09-28T00:22:59.706544+0000","last_fullsized":"2023-09-28T00:22:59.706544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.699416+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.699416+0000","last_peered":"2023-09-28T00:22:59.699416+0000","last_clean":"2023-09-28T00:22:59.699416+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.699416+0000","last_undegraded":"2023-09-28T00:22:59.699416+0000","last_fullsized":"2023-09-28T00:22:59.699416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706323+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.706323+0000","last_peered":"2023-09-28T00:22:59.706323+0000","last_clean":"2023-09-28T00:22:59.706323+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.706323+0000","last_undegraded":"2023-09-28T00:22:59.706323+0000","last_fullsized":"2023-09-28T00:22:59.706323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717199+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.717199+0000","last_peered":"2023-09-28T00:22:59.717199+0000","last_clean":"2023-09-28T00:22:59.717199+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.717199+0000","last_undegraded":"2023-09-28T00:22:59.717199+0000","last_fullsized":"2023-09-28T00:22:59.717199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706336+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.706336+0000","last_peered":"2023-09-28T00:22:59.706336+0000","last_clean":"2023-09-28T00:22:59.706336+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.706336+0000","last_undegraded":"2023-09-28T00:22:59.706336+0000","last_fullsized":"2023-09-28T00:22:59.706336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717656+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.717656+0000","last_peered":"2023-09-28T00:22:59.717656+0000","last_clean":"2023-09-28T00:22:59.717656+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.717656+0000","last_undegraded":"2023-09-28T00:22:59.717656+0000","last_fullsized":"2023-09-28T00:22:59.717656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713628+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.713628+0000","last_peered":"2023-09-28T00:22:59.713628+0000","last_clean":"2023-09-28T00:22:59.713628+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.713628+0000","last_undegraded":"2023-09-28T00:22:59.713628+0000","last_fullsized":"2023-09-28T00:22:59.713628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721596+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:23:04.721596+0000","last_peered":"2023-09-28T00:23:04.721596+0000","last_clean":"2023-09-28T00:23:04.721596+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:04.721596+0000","last_undegraded":"2023-09-28T00:23:04.721596+0000","last_fullsized":"2023-09-28T00:23:04.721596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721198+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721198+0000","last_peered":"2023-09-28T00:23:03.721198+0000","last_clean":"2023-09-28T00:23:03.721198+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721198+0000","last_undegraded":"2023-09-28T00:23:03.721198+0000","last_fullsized":"2023-09-28T00:23:03.721198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.717925+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:04.717925+0000","last_peered":"2023-09-28T00:23:04.717925+0000","last_clean":"2023-09-28T00:23:04.717925+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:04.717925+0000","last_undegraded":"2023-09-28T00:23:04.717925+0000","last_fullsized":"2023-09-28T00:23:04.717925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.710025+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.710025+0000","last_peered":"2023-09-28T00:23:02.710025+0000","last_clean":"2023-09-28T00:23:02.710025+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.710025+0000","last_undegraded":"2023-09-28T00:23:02.710025+0000","last_fullsized":"2023-09-28T00:23:02.710025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728314+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:23:05.728314+0000","last_peered":"2023-09-28T00:23:05.728314+0000","last_clean":"2023-09-28T00:23:05.728314+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:05.728314+0000","last_undegraded":"2023-09-28T00:23:05.728314+0000","last_fullsized":"2023-09-28T00:23:05.728314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728766+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728766+0000","last_peered":"2023-09-28T00:23:05.728766+0000","last_clean":"2023-09-28T00:23:05.728766+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728766+0000","last_undegraded":"2023-09-28T00:23:05.728766+0000","last_fullsized":"2023-09-28T00:23:05.728766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723035+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.723035+0000","last_peered":"2023-09-28T00:22:59.723035+0000","last_clean":"2023-09-28T00:22:59.723035+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.723035+0000","last_undegraded":"2023-09-28T00:22:59.723035+0000","last_fullsized":"2023-09-28T00:22:59.723035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726359+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726359+0000","last_peered":"2023-09-28T00:23:05.726359+0000","last_clean":"2023-09-28T00:23:05.726359+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726359+0000","last_undegraded":"2023-09-28T00:23:05.726359+0000","last_fullsized":"2023-09-28T00:23:05.726359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720017+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:04.720017+0000","last_peered":"2023-09-28T00:23:04.720017+0000","last_clean":"2023-09-28T00:23:04.720017+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:04.720017+0000","last_undegraded":"2023-09-28T00:23:04.720017+0000","last_fullsized":"2023-09-28T00:23:04.720017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722483+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:04.722483+0000","last_peered":"2023-09-28T00:23:04.722483+0000","last_clean":"2023-09-28T00:23:04.722483+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:04.722483+0000","last_undegraded":"2023-09-28T00:23:04.722483+0000","last_fullsized":"2023-09-28T00:23:04.722483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'17","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722261+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:23:04.722261+0000","last_peered":"2023-09-28T00:23:04.722261+0000","last_clean":"2023-09-28T00:23:04.722261+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:04.722261+0000","last_undegraded":"2023-09-28T00:23:04.722261+0000","last_fullsized":"2023-09-28T00:23:04.722261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188982+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:23:02.188982+0000","last_peered":"2023-09-28T00:23:02.188982+0000","last_clean":"2023-09-28T00:23:02.188982+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:02.188982+0000","last_undegraded":"2023-09-28T00:23:02.188982+0000","last_fullsized":"2023-09-28T00:23:02.188982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728186+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:23:05.728186+0000","last_peered":"2023-09-28T00:23:05.728186+0000","last_clean":"2023-09-28T00:23:05.728186+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:05.728186+0000","last_undegraded":"2023-09-28T00:23:05.728186+0000","last_fullsized":"2023-09-28T00:23:05.728186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715645+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.715645+0000","last_peered":"2023-09-28T00:22:59.715645+0000","last_clean":"2023-09-28T00:22:59.715645+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.715645+0000","last_undegraded":"2023-09-28T00:22:59.715645+0000","last_fullsized":"2023-09-28T00:22:59.715645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721507+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:23:04.721507+0000","last_peered":"2023-09-28T00:23:04.721507+0000","last_clean":"2023-09-28T00:23:04.721507+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:04.721507+0000","last_undegraded":"2023-09-28T00:23:04.721507+0000","last_fullsized":"2023-09-28T00:23:04.721507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723111+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.723111+0000","last_peered":"2023-09-28T00:22:59.723111+0000","last_clean":"2023-09-28T00:22:59.723111+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.723111+0000","last_undegraded":"2023-09-28T00:22:59.723111+0000","last_fullsized":"2023-09-28T00:22:59.723111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718572+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:04.718572+0000","last_peered":"2023-09-28T00:23:04.718572+0000","last_clean":"2023-09-28T00:23:04.718572+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:04.718572+0000","last_undegraded":"2023-09-28T00:23:04.718572+0000","last_fullsized":"2023-09-28T00:23:04.718572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722580+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:04.722580+0000","last_peered":"2023-09-28T00:23:04.722580+0000","last_clean":"2023-09-28T00:23:04.722580+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:04.722580+0000","last_undegraded":"2023-09-28T00:23:04.722580+0000","last_fullsized":"2023-09-28T00:23:04.722580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725840+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725840+0000","last_peered":"2023-09-28T00:23:05.725840+0000","last_clean":"2023-09-28T00:23:05.725840+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725840+0000","last_undegraded":"2023-09-28T00:23:05.725840+0000","last_fullsized":"2023-09-28T00:23:05.725840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723139+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.723139+0000","last_peered":"2023-09-28T00:22:59.723139+0000","last_clean":"2023-09-28T00:22:59.723139+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.723139+0000","last_undegraded":"2023-09-28T00:22:59.723139+0000","last_fullsized":"2023-09-28T00:22:59.723139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720076+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:23:04.720076+0000","last_peered":"2023-09-28T00:23:04.720076+0000","last_clean":"2023-09-28T00:23:04.720076+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:04.720076+0000","last_undegraded":"2023-09-28T00:23:04.720076+0000","last_fullsized":"2023-09-28T00:23:04.720076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720391+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:04.720391+0000","last_peered":"2023-09-28T00:23:04.720391+0000","last_clean":"2023-09-28T00:23:04.720391+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:04.720391+0000","last_undegraded":"2023-09-28T00:23:04.720391+0000","last_fullsized":"2023-09-28T00:23:04.720391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719030+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.719030+0000","last_peered":"2023-09-28T00:23:03.719030+0000","last_clean":"2023-09-28T00:23:03.719030+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.719030+0000","last_undegraded":"2023-09-28T00:23:03.719030+0000","last_fullsized":"2023-09-28T00:23:03.719030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691167+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.691167+0000","last_peered":"2023-09-28T00:22:59.691167+0000","last_clean":"2023-09-28T00:22:59.691167+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.691167+0000","last_undegraded":"2023-09-28T00:22:59.691167+0000","last_fullsized":"2023-09-28T00:22:59.691167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728787+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:05.728787+0000","last_peered":"2023-09-28T00:23:05.728787+0000","last_clean":"2023-09-28T00:23:05.728787+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:05.728787+0000","last_undegraded":"2023-09-28T00:23:05.728787+0000","last_fullsized":"2023-09-28T00:23:05.728787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719836+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.719836+0000","last_peered":"2023-09-28T00:23:03.719836+0000","last_clean":"2023-09-28T00:23:03.719836+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.719836+0000","last_undegraded":"2023-09-28T00:23:03.719836+0000","last_fullsized":"2023-09-28T00:23:03.719836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189439+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:23:02.189439+0000","last_peered":"2023-09-28T00:23:02.189439+0000","last_clean":"2023-09-28T00:23:02.189439+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:02.189439+0000","last_undegraded":"2023-09-28T00:23:02.189439+0000","last_fullsized":"2023-09-28T00:23:02.189439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722475+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:05.722475+0000","last_peered":"2023-09-28T00:23:05.722475+0000","last_clean":"2023-09-28T00:23:05.722475+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:05.722475+0000","last_undegraded":"2023-09-28T00:23:05.722475+0000","last_fullsized":"2023-09-28T00:23:05.722475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718240+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:04.718240+0000","last_peered":"2023-09-28T00:23:04.718240+0000","last_clean":"2023-09-28T00:23:04.718240+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:04.718240+0000","last_undegraded":"2023-09-28T00:23:04.718240+0000","last_fullsized":"2023-09-28T00:23:04.718240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722920+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.722920+0000","last_peered":"2023-09-28T00:22:59.722920+0000","last_clean":"2023-09-28T00:22:59.722920+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.722920+0000","last_undegraded":"2023-09-28T00:22:59.722920+0000","last_fullsized":"2023-09-28T00:22:59.722920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725530+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:23:05.725530+0000","last_peered":"2023-09-28T00:23:05.725530+0000","last_clean":"2023-09-28T00:23:05.725530+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:05.725530+0000","last_undegraded":"2023-09-28T00:23:05.725530+0000","last_fullsized":"2023-09-28T00:23:05.725530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710487+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.710487+0000","last_peered":"2023-09-28T00:22:59.710487+0000","last_clean":"2023-09-28T00:22:59.710487+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.710487+0000","last_undegraded":"2023-09-28T00:22:59.710487+0000","last_fullsized":"2023-09-28T00:22:59.710487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'12","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.727227+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:05.727227+0000","last_peered":"2023-09-28T00:23:05.727227+0000","last_clean":"2023-09-28T00:23:05.727227+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:05.727227+0000","last_undegraded":"2023-09-28T00:23:05.727227+0000","last_fullsized":"2023-09-28T00:23:05.727227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712741+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.712741+0000","last_peered":"2023-09-28T00:22:59.712741+0000","last_clean":"2023-09-28T00:22:59.712741+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.712741+0000","last_undegraded":"2023-09-28T00:22:59.712741+0000","last_fullsized":"2023-09-28T00:22:59.712741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'13","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725695+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:05.725695+0000","last_peered":"2023-09-28T00:23:05.725695+0000","last_clean":"2023-09-28T00:23:05.725695+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:05.725695+0000","last_undegraded":"2023-09-28T00:23:05.725695+0000","last_fullsized":"2023-09-28T00:23:05.725695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710691+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.710691+0000","last_peered":"2023-09-28T00:22:59.710691+0000","last_clean":"2023-09-28T00:22:59.710691+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.710691+0000","last_undegraded":"2023-09-28T00:22:59.710691+0000","last_fullsized":"2023-09-28T00:22:59.710691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706526+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.706526+0000","last_peered":"2023-09-28T00:22:59.706526+0000","last_clean":"2023-09-28T00:22:59.706526+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.706526+0000","last_undegraded":"2023-09-28T00:22:59.706526+0000","last_fullsized":"2023-09-28T00:22:59.706526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13284,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358556,"statfs":{"total":96636764160,"available":96623161344,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8088,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363752,"statfs":{"total":96636764160,"available":96628482048,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:24.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:24.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.665+0000 7f022299d700 1 Processor -- start 2023-09-28T00:23:24.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.665+0000 7f022299d700 1 -- start start 2023-09-28T00:23:24.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.666+0000 7f022299d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f021c0add10 0x7f021c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.666+0000 7f022299d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c068b60 0x7f021c0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.666+0000 7f022299d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c159b20 con 0x7f021c159610 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.666+0000 7f022299d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0c7350 con 0x7f021c0add10 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.666+0000 7f022299d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c155b50 con 0x7f021c068b60 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022199b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f021c0add10 0x7f021c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022119a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c068b60 0x7f021c0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022219c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f021c159610 0x7f021c14f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:36738/0 (socket says 172.21.15.53:36738) 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022219c700 1 -- 172.21.15.53:0/4233229674 learned_addr learned my addr 172.21.15.53:0/4233229674 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022199b700 1 -- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c068b60 msgr2=0x7f021c0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022199b700 1 --2- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c068b60 0x7f021c0ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022199b700 1 -- 172.21.15.53:0/4233229674 >> v1:172.21.15.118:6789/0 conn(0x7f021c159610 legacy=0x7f021c14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022199b700 1 -- 172.21.15.53:0/4233229674 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0c6d90 con 0x7f021c0add10 2023-09-28T00:23:24.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f022119a700 1 --2- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c068b60 0x7f021c0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:24.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.667+0000 7f0220999700 1 -- 172.21.15.53:0/4233229674 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911396426 0 0) 0x7f021c159b20 con 0x7f021c159610 2023-09-28T00:23:24.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022199b700 1 --2- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c0add10 0x7f021c155fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f02180098e0 tx=0x7f02180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93572aa332061ecb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:24.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f0220999700 1 -- 172.21.15.53:0/4233229674 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800b640 con 0x7f021c0add10 2023-09-28T00:23:24.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f0220999700 1 -- 172.21.15.53:0/4233229674 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800b7a0 con 0x7f021c0add10 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f0220999700 1 -- 172.21.15.53:0/4233229674 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800bb40 con 0x7f021c0add10 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022299d700 1 -- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c0add10 msgr2=0x7f021c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022299d700 1 --2- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c0add10 0x7f021c155fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f02180098e0 tx=0x7f02180091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022299d700 1 -- 172.21.15.53:0/4233229674 shutdown_connections 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022299d700 1 --2- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c0add10 0x7f021c155fe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022299d700 1 --2- 172.21.15.53:0/4233229674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c068b60 0x7f021c0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.668+0000 7f022299d700 1 -- 172.21.15.53:0/4233229674 >> 172.21.15.53:0/4233229674 conn(0x7f021c06f7f0 msgr2=0x7f021c0cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.669+0000 7f022299d700 1 -- 172.21.15.53:0/4233229674 shutdown_connections 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.669+0000 7f022299d700 1 -- 172.21.15.53:0/4233229674 wait complete. 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.670+0000 7f022299d700 1 Processor -- start 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.670+0000 7f022299d700 1 -- start start 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022299d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 0x7f021c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022299d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c0add10 0x7f021c168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022299d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c159610 0x7f021c168660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022299d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c152930 con 0x7f021c068b60 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022299d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0af9f0 con 0x7f021c159610 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022299d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0aebe0 con 0x7f021c0add10 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022199b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 0x7f021c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022199b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 0x7f021c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48474/0 (socket says 172.21.15.53:48474) 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022199b700 1 -- 172.21.15.53:0/3037112341 learned_addr learned my addr 172.21.15.53:0/3037112341 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022119a700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c0add10 0x7f021c168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.671+0000 7f022219c700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c159610 0x7f021c168660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022199b700 1 -- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c0add10 msgr2=0x7f021c168120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022199b700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c0add10 0x7f021c168120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022199b700 1 -- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c159610 msgr2=0x7f021c168660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022199b700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c159610 0x7f021c168660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022199b700 1 -- 172.21.15.53:0/3037112341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009420 con 0x7f021c068b60 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022199b700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 0x7f021c0afe80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f021c0685e0 tx=0x7f0218017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800bb20 con 0x7f021c068b60 2023-09-28T00:23:24.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218000c90 con 0x7f021c068b60 2023-09-28T00:23:24.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218011630 con 0x7f021c068b60 2023-09-28T00:23:24.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.672+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0218009420 con 0x7f021c068b60 2023-09-28T00:23:24.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.673+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0aee40 con 0x7f021c068b60 2023-09-28T00:23:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.674+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c04c3c0 con 0x7f021c068b60 2023-09-28T00:23:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.674+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0218011a20 con 0x7f021c068b60 2023-09-28T00:23:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.675+0000 7f0211ffb700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0200067330 0x7f02000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.675+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0218086410 con 0x7f021c068b60 2023-09-28T00:23:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.675+0000 7f022119a700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0200067330 0x7f02000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.676+0000 7f022119a700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0200067330 0x7f02000697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f021c155610 tx=0x7f020c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:24.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.679+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0218053270 con 0x7f021c068b60 2023-09-28T00:23:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.879+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f021c0afb30 con 0x7f0200067330 2023-09-28T00:23:24.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.888+0000 7f0211ffb700 1 -- 172.21.15.53:0/3037112341 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284734 (secure 0 0 0) 0x7f020c01a030 con 0x7f0200067330 2023-09-28T00:23:24.892 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0200067330 msgr2=0x7f02000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0200067330 0x7f02000697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f021c155610 tx=0x7f020c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 msgr2=0x7f021c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 0x7f021c0afe80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f021c0685e0 tx=0x7f0218017000 comp rx=0 tx=0).stop 2023-09-28T00:23:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 shutdown_connections 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f0200067330 0x7f02000697e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f021c159610 0x7f021c168660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f021c068b60 0x7f021c0afe80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 --2- 172.21.15.53:0/3037112341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f021c0add10 0x7f021c168120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 >> 172.21.15.53:0/3037112341 conn(0x7f021c06f7f0 msgr2=0x7f021c063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 shutdown_connections 2023-09-28T00:23:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:24.892+0000 7f022299d700 1 -- 172.21.15.53:0/3037112341 wait complete. 2023-09-28T00:23:24.896 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:24.909 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-09-28T00:23:23.107695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83496,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80000,"kb_avail":754891224,"statfs":{"total":773094113280,"available":773008613376,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81920000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003156"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711001+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.711001+0000","last_peered":"2023-09-28T00:22:59.711001+0000","last_clean":"2023-09-28T00:22:59.711001+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.711001+0000","last_undegraded":"2023-09-28T00:22:59.711001+0000","last_fullsized":"2023-09-28T00:22:59.711001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706544+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.706544+0000","last_peered":"2023-09-28T00:22:59.706544+0000","last_clean":"2023-09-28T00:22:59.706544+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.706544+0000","last_undegraded":"2023-09-28T00:22:59.706544+0000","last_fullsized":"2023-09-28T00:22:59.706544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.699416+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.699416+0000","last_peered":"2023-09-28T00:22:59.699416+0000","last_clean":"2023-09-28T00:22:59.699416+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.699416+0000","last_undegraded":"2023-09-28T00:22:59.699416+0000","last_fullsized":"2023-09-28T00:22:59.699416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706323+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.706323+0000","last_peered":"2023-09-28T00:22:59.706323+0000","last_clean":"2023-09-28T00:22:59.706323+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.706323+0000","last_undegraded":"2023-09-28T00:22:59.706323+0000","last_fullsized":"2023-09-28T00:22:59.706323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717199+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.717199+0000","last_peered":"2023-09-28T00:22:59.717199+0000","last_clean":"2023-09-28T00:22:59.717199+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.717199+0000","last_undegraded":"2023-09-28T00:22:59.717199+0000","last_fullsized":"2023-09-28T00:22:59.717199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706336+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.706336+0000","last_peered":"2023-09-28T00:22:59.706336+0000","last_clean":"2023-09-28T00:22:59.706336+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.706336+0000","last_undegraded":"2023-09-28T00:22:59.706336+0000","last_fullsized":"2023-09-28T00:22:59.706336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717656+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.717656+0000","last_peered":"2023-09-28T00:22:59.717656+0000","last_clean":"2023-09-28T00:22:59.717656+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.717656+0000","last_undegraded":"2023-09-28T00:22:59.717656+0000","last_fullsized":"2023-09-28T00:22:59.717656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713628+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.713628+0000","last_peered":"2023-09-28T00:22:59.713628+0000","last_clean":"2023-09-28T00:22:59.713628+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.713628+0000","last_undegraded":"2023-09-28T00:22:59.713628+0000","last_fullsized":"2023-09-28T00:22:59.713628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721596+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:23:04.721596+0000","last_peered":"2023-09-28T00:23:04.721596+0000","last_clean":"2023-09-28T00:23:04.721596+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:04.721596+0000","last_undegraded":"2023-09-28T00:23:04.721596+0000","last_fullsized":"2023-09-28T00:23:04.721596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721198+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721198+0000","last_peered":"2023-09-28T00:23:03.721198+0000","last_clean":"2023-09-28T00:23:03.721198+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721198+0000","last_undegraded":"2023-09-28T00:23:03.721198+0000","last_fullsized":"2023-09-28T00:23:03.721198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.717925+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:04.717925+0000","last_peered":"2023-09-28T00:23:04.717925+0000","last_clean":"2023-09-28T00:23:04.717925+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:04.717925+0000","last_undegraded":"2023-09-28T00:23:04.717925+0000","last_fullsized":"2023-09-28T00:23:04.717925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.710025+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.710025+0000","last_peered":"2023-09-28T00:23:02.710025+0000","last_clean":"2023-09-28T00:23:02.710025+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.710025+0000","last_undegraded":"2023-09-28T00:23:02.710025+0000","last_fullsized":"2023-09-28T00:23:02.710025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728314+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:23:05.728314+0000","last_peered":"2023-09-28T00:23:05.728314+0000","last_clean":"2023-09-28T00:23:05.728314+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:05.728314+0000","last_undegraded":"2023-09-28T00:23:05.728314+0000","last_fullsized":"2023-09-28T00:23:05.728314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728766+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728766+0000","last_peered":"2023-09-28T00:23:05.728766+0000","last_clean":"2023-09-28T00:23:05.728766+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728766+0000","last_undegraded":"2023-09-28T00:23:05.728766+0000","last_fullsized":"2023-09-28T00:23:05.728766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723035+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.723035+0000","last_peered":"2023-09-28T00:22:59.723035+0000","last_clean":"2023-09-28T00:22:59.723035+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.723035+0000","last_undegraded":"2023-09-28T00:22:59.723035+0000","last_fullsized":"2023-09-28T00:22:59.723035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726359+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726359+0000","last_peered":"2023-09-28T00:23:05.726359+0000","last_clean":"2023-09-28T00:23:05.726359+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726359+0000","last_undegraded":"2023-09-28T00:23:05.726359+0000","last_fullsized":"2023-09-28T00:23:05.726359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720017+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:04.720017+0000","last_peered":"2023-09-28T00:23:04.720017+0000","last_clean":"2023-09-28T00:23:04.720017+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:04.720017+0000","last_undegraded":"2023-09-28T00:23:04.720017+0000","last_fullsized":"2023-09-28T00:23:04.720017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722483+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:04.722483+0000","last_peered":"2023-09-28T00:23:04.722483+0000","last_clean":"2023-09-28T00:23:04.722483+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:04.722483+0000","last_undegraded":"2023-09-28T00:23:04.722483+0000","last_fullsized":"2023-09-28T00:23:04.722483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'17","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722261+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:23:04.722261+0000","last_peered":"2023-09-28T00:23:04.722261+0000","last_clean":"2023-09-28T00:23:04.722261+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:04.722261+0000","last_undegraded":"2023-09-28T00:23:04.722261+0000","last_fullsized":"2023-09-28T00:23:04.722261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188982+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:23:02.188982+0000","last_peered":"2023-09-28T00:23:02.188982+0000","last_clean":"2023-09-28T00:23:02.188982+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:02.188982+0000","last_undegraded":"2023-09-28T00:23:02.188982+0000","last_fullsized":"2023-09-28T00:23:02.188982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728186+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:23:05.728186+0000","last_peered":"2023-09-28T00:23:05.728186+0000","last_clean":"2023-09-28T00:23:05.728186+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:05.728186+0000","last_undegraded":"2023-09-28T00:23:05.728186+0000","last_fullsized":"2023-09-28T00:23:05.728186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715645+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.715645+0000","last_peered":"2023-09-28T00:22:59.715645+0000","last_clean":"2023-09-28T00:22:59.715645+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.715645+0000","last_undegraded":"2023-09-28T00:22:59.715645+0000","last_fullsized":"2023-09-28T00:22:59.715645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721507+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:23:04.721507+0000","last_peered":"2023-09-28T00:23:04.721507+0000","last_clean":"2023-09-28T00:23:04.721507+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:04.721507+0000","last_undegraded":"2023-09-28T00:23:04.721507+0000","last_fullsized":"2023-09-28T00:23:04.721507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723111+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.723111+0000","last_peered":"2023-09-28T00:22:59.723111+0000","last_clean":"2023-09-28T00:22:59.723111+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.723111+0000","last_undegraded":"2023-09-28T00:22:59.723111+0000","last_fullsized":"2023-09-28T00:22:59.723111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718572+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:04.718572+0000","last_peered":"2023-09-28T00:23:04.718572+0000","last_clean":"2023-09-28T00:23:04.718572+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:04.718572+0000","last_undegraded":"2023-09-28T00:23:04.718572+0000","last_fullsized":"2023-09-28T00:23:04.718572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722580+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:04.722580+0000","last_peered":"2023-09-28T00:23:04.722580+0000","last_clean":"2023-09-28T00:23:04.722580+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:04.722580+0000","last_undegraded":"2023-09-28T00:23:04.722580+0000","last_fullsized":"2023-09-28T00:23:04.722580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725840+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725840+0000","last_peered":"2023-09-28T00:23:05.725840+0000","last_clean":"2023-09-28T00:23:05.725840+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725840+0000","last_undegraded":"2023-09-28T00:23:05.725840+0000","last_fullsized":"2023-09-28T00:23:05.725840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723139+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.723139+0000","last_peered":"2023-09-28T00:22:59.723139+0000","last_clean":"2023-09-28T00:22:59.723139+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.723139+0000","last_undegraded":"2023-09-28T00:22:59.723139+0000","last_fullsized":"2023-09-28T00:22:59.723139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720076+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:23:04.720076+0000","last_peered":"2023-09-28T00:23:04.720076+0000","last_clean":"2023-09-28T00:23:04.720076+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:04.720076+0000","last_undegraded":"2023-09-28T00:23:04.720076+0000","last_fullsized":"2023-09-28T00:23:04.720076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720391+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:04.720391+0000","last_peered":"2023-09-28T00:23:04.720391+0000","last_clean":"2023-09-28T00:23:04.720391+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:04.720391+0000","last_undegraded":"2023-09-28T00:23:04.720391+0000","last_fullsized":"2023-09-28T00:23:04.720391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719030+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.719030+0000","last_peered":"2023-09-28T00:23:03.719030+0000","last_clean":"2023-09-28T00:23:03.719030+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.719030+0000","last_undegraded":"2023-09-28T00:23:03.719030+0000","last_fullsized":"2023-09-28T00:23:03.719030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691167+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.691167+0000","last_peered":"2023-09-28T00:22:59.691167+0000","last_clean":"2023-09-28T00:22:59.691167+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.691167+0000","last_undegraded":"2023-09-28T00:22:59.691167+0000","last_fullsized":"2023-09-28T00:22:59.691167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728787+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:05.728787+0000","last_peered":"2023-09-28T00:23:05.728787+0000","last_clean":"2023-09-28T00:23:05.728787+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:05.728787+0000","last_undegraded":"2023-09-28T00:23:05.728787+0000","last_fullsized":"2023-09-28T00:23:05.728787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719836+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.719836+0000","last_peered":"2023-09-28T00:23:03.719836+0000","last_clean":"2023-09-28T00:23:03.719836+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.719836+0000","last_undegraded":"2023-09-28T00:23:03.719836+0000","last_fullsized":"2023-09-28T00:23:03.719836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189439+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:23:02.189439+0000","last_peered":"2023-09-28T00:23:02.189439+0000","last_clean":"2023-09-28T00:23:02.189439+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:02.189439+0000","last_undegraded":"2023-09-28T00:23:02.189439+0000","last_fullsized":"2023-09-28T00:23:02.189439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722475+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:05.722475+0000","last_peered":"2023-09-28T00:23:05.722475+0000","last_clean":"2023-09-28T00:23:05.722475+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:05.722475+0000","last_undegraded":"2023-09-28T00:23:05.722475+0000","last_fullsized":"2023-09-28T00:23:05.722475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718240+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:04.718240+0000","last_peered":"2023-09-28T00:23:04.718240+0000","last_clean":"2023-09-28T00:23:04.718240+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:04.718240+0000","last_undegraded":"2023-09-28T00:23:04.718240+0000","last_fullsized":"2023-09-28T00:23:04.718240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722920+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.722920+0000","last_peered":"2023-09-28T00:22:59.722920+0000","last_clean":"2023-09-28T00:22:59.722920+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.722920+0000","last_undegraded":"2023-09-28T00:22:59.722920+0000","last_fullsized":"2023-09-28T00:22:59.722920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725530+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:23:05.725530+0000","last_peered":"2023-09-28T00:23:05.725530+0000","last_clean":"2023-09-28T00:23:05.725530+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:05.725530+0000","last_undegraded":"2023-09-28T00:23:05.725530+0000","last_fullsized":"2023-09-28T00:23:05.725530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710487+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.710487+0000","last_peered":"2023-09-28T00:22:59.710487+0000","last_clean":"2023-09-28T00:22:59.710487+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.710487+0000","last_undegraded":"2023-09-28T00:22:59.710487+0000","last_fullsized":"2023-09-28T00:22:59.710487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'12","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.727227+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:05.727227+0000","last_peered":"2023-09-28T00:23:05.727227+0000","last_clean":"2023-09-28T00:23:05.727227+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:05.727227+0000","last_undegraded":"2023-09-28T00:23:05.727227+0000","last_fullsized":"2023-09-28T00:23:05.727227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712741+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.712741+0000","last_peered":"2023-09-28T00:22:59.712741+0000","last_clean":"2023-09-28T00:22:59.712741+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.712741+0000","last_undegraded":"2023-09-28T00:22:59.712741+0000","last_fullsized":"2023-09-28T00:22:59.712741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'13","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725695+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:05.725695+0000","last_peered":"2023-09-28T00:23:05.725695+0000","last_clean":"2023-09-28T00:23:05.725695+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:05.725695+0000","last_undegraded":"2023-09-28T00:23:05.725695+0000","last_fullsized":"2023-09-28T00:23:05.725695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710691+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.710691+0000","last_peered":"2023-09-28T00:22:59.710691+0000","last_clean":"2023-09-28T00:22:59.710691+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.710691+0000","last_undegraded":"2023-09-28T00:22:59.710691+0000","last_fullsized":"2023-09-28T00:22:59.710691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706526+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.706526+0000","last_peered":"2023-09-28T00:22:59.706526+0000","last_clean":"2023-09-28T00:22:59.706526+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.706526+0000","last_undegraded":"2023-09-28T00:22:59.706526+0000","last_fullsized":"2023-09-28T00:22:59.706526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13284,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358556,"statfs":{"total":96636764160,"available":96623161344,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8088,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363752,"statfs":{"total":96636764160,"available":96628482048,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:24.916 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T00:23:24.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:25.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.137+0000 7f9643fff700 1 Processor -- start 2023-09-28T00:23:25.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.137+0000 7f9643fff700 1 -- start start 2023-09-28T00:23:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.138+0000 7f9643fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96440add50 0x7f96441560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.138+0000 7f9643fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440ccaa0 con 0x7f9644069ca0 2023-09-28T00:23:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.138+0000 7f9643fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440ae830 con 0x7f96440cc560 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.138+0000 7f9643fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9644068c00 con 0x7f96440add50 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.138+0000 7f96437fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9644069ca0 0x7f964414f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41168/0 (socket says 172.21.15.53:41168) 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.138+0000 7f96437fe700 1 -- 172.21.15.53:0/2017384288 learned_addr learned my addr 172.21.15.53:0/2017384288 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9642ffd700 1 --2- 172.21.15.53:0/2017384288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96440add50 0x7f96441560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9641ffb700 1 -- 172.21.15.53:0/2017384288 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101498774 0 0) 0x7f96440ae830 con 0x7f96440cc560 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9641ffb700 1 -- 172.21.15.53:0/2017384288 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f962c003570 con 0x7f96440cc560 2023-09-28T00:23:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9641ffb700 1 -- 172.21.15.53:0/2017384288 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309397790 0 0) 0x7f96440ccaa0 con 0x7f9644069ca0 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9642ffd700 1 -- 172.21.15.53:0/2017384288 >> v1:172.21.15.118:6789/0 conn(0x7f96440cc560 legacy=0x7f96440ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9642ffd700 1 -- 172.21.15.53:0/2017384288 >> v1:172.21.15.53:6789/0 conn(0x7f9644069ca0 legacy=0x7f964414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9642ffd700 1 -- 172.21.15.53:0/2017384288 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644068ee0 con 0x7f96440add50 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.139+0000 7f9642ffd700 1 --2- 172.21.15.53:0/2017384288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96440add50 0x7f96441560f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9634009910 tx=0x7f96340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe7e5a8db909b60 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9641ffb700 1 -- 172.21.15.53:0/2017384288 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400b710 con 0x7f96440add50 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9641ffb700 1 -- 172.21.15.53:0/2017384288 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963400b870 con 0x7f96440add50 2023-09-28T00:23:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9641ffb700 1 -- 172.21.15.53:0/2017384288 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400bc30 con 0x7f96440add50 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 -- 172.21.15.53:0/2017384288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96440add50 msgr2=0x7f96441560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 --2- 172.21.15.53:0/2017384288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96440add50 0x7f96441560f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9634009910 tx=0x7f96340091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 -- 172.21.15.53:0/2017384288 shutdown_connections 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 --2- 172.21.15.53:0/2017384288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96440add50 0x7f96441560f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 -- 172.21.15.53:0/2017384288 >> 172.21.15.53:0/2017384288 conn(0x7f964406f7f0 msgr2=0x7f96440cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 -- 172.21.15.53:0/2017384288 shutdown_connections 2023-09-28T00:23:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.140+0000 7f9643fff700 1 -- 172.21.15.53:0/2017384288 wait complete. 2023-09-28T00:23:25.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.142+0000 7f9643fff700 1 Processor -- start 2023-09-28T00:23:25.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.142+0000 7f9643fff700 1 -- start start 2023-09-28T00:23:25.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.142+0000 7f9643fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9644069ca0 0x7f9644149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.142+0000 7f9643fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 0x7f96440cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f9643fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96440cc560 0x7f96440cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f9643fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441698e0 con 0x7f96440add50 2023-09-28T00:23:25.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f9643fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644153550 con 0x7f96440cc560 2023-09-28T00:23:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f9643fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9644168c60 con 0x7f9644069ca0 2023-09-28T00:23:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 0x7f96440cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 0x7f96440cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48490/0 (socket says 172.21.15.53:48490) 2023-09-28T00:23:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 -- 172.21.15.53:0/889545848 learned_addr learned my addr 172.21.15.53:0/889545848 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96437fe700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96440cc560 0x7f96440cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f9642ffd700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9644069ca0 0x7f9644149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 -- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9644069ca0 msgr2=0x7f9644149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9644069ca0 0x7f9644149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 -- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96440cc560 msgr2=0x7f96440cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96440cc560 0x7f96440cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.143+0000 7f96427fc700 1 -- 172.21.15.53:0/889545848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009420 con 0x7f96440add50 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.144+0000 7f96427fc700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 0x7f96440cb300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f963800c590 tx=0x7f9638007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:25.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.144+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638010510 con 0x7f96440add50 2023-09-28T00:23:25.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.144+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638010670 con 0x7f96440add50 2023-09-28T00:23:25.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.144+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9644168f40 con 0x7f96440add50 2023-09-28T00:23:25.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.144+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638010a30 con 0x7f96440add50 2023-09-28T00:23:25.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.144+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9644169500 con 0x7f96440add50 2023-09-28T00:23:25.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.145+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96441696c0 con 0x7f96440add50 2023-09-28T00:23:25.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.146+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f963801b400 con 0x7f96440add50 2023-09-28T00:23:25.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.147+0000 7f962affd700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9630067330 0x7f96300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.147+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9638084730 con 0x7f96440add50 2023-09-28T00:23:25.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.147+0000 7f9642ffd700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9630067330 0x7f96300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.148+0000 7f9642ffd700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9630067330 0x7f96300697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f963400c010 tx=0x7f9634017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:25.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.150+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9638051590 con 0x7f96440add50 2023-09-28T00:23:25.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.349+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9644169a20 con 0x7f9630067330 2023-09-28T00:23:25.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.358+0000 7f962affd700 1 -- 172.21.15.53:0/889545848 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284718 (secure 0 0 0) 0x7f9644169a20 con 0x7f9630067330 2023-09-28T00:23:25.361 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9630067330 msgr2=0x7f96300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9630067330 0x7f96300697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f963400c010 tx=0x7f9634017000 comp rx=0 tx=0).stop 2023-09-28T00:23:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 msgr2=0x7f96440cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 0x7f96440cb300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f963800c590 tx=0x7f9638007dc0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 shutdown_connections 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9630067330 0x7f96300697e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9644069ca0 0x7f9644149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96440cc560 0x7f96440cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 --2- 172.21.15.53:0/889545848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96440add50 0x7f96440cb300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 >> 172.21.15.53:0/889545848 conn(0x7f964406f7f0 msgr2=0x7f9644154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 shutdown_connections 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.362+0000 7f9643fff700 1 -- 172.21.15.53:0/889545848 wait complete. 2023-09-28T00:23:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:25.379 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-09-28T00:23:25.108091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83496,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80000,"kb_avail":754891224,"statfs":{"total":773094113280,"available":773008613376,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81920000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002958"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.711001+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:22:59.711001+0000","last_peered":"2023-09-28T00:22:59.711001+0000","last_clean":"2023-09-28T00:22:59.711001+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:22:59.711001+0000","last_undegraded":"2023-09-28T00:22:59.711001+0000","last_fullsized":"2023-09-28T00:22:59.711001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:32.480867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707939+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:22:59.707939+0000","last_peered":"2023-09-28T00:22:59.707939+0000","last_clean":"2023-09-28T00:22:59.707939+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:22:59.707939+0000","last_undegraded":"2023-09-28T00:22:59.707939+0000","last_fullsized":"2023-09-28T00:22:59.707939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714900+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:22:59.714900+0000","last_peered":"2023-09-28T00:22:59.714900+0000","last_clean":"2023-09-28T00:22:59.714900+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:22:59.714900+0000","last_undegraded":"2023-09-28T00:22:59.714900+0000","last_fullsized":"2023-09-28T00:22:59.714900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706544+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:22:59.706544+0000","last_peered":"2023-09-28T00:22:59.706544+0000","last_clean":"2023-09-28T00:22:59.706544+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:22:59.706544+0000","last_undegraded":"2023-09-28T00:22:59.706544+0000","last_fullsized":"2023-09-28T00:22:59.706544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:45:40.072601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.699416+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:22:59.699416+0000","last_peered":"2023-09-28T00:22:59.699416+0000","last_clean":"2023-09-28T00:22:59.699416+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:22:59.699416+0000","last_undegraded":"2023-09-28T00:22:59.699416+0000","last_fullsized":"2023-09-28T00:22:59.699416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706323+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:22:59.706323+0000","last_peered":"2023-09-28T00:22:59.706323+0000","last_clean":"2023-09-28T00:22:59.706323+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:22:59.706323+0000","last_undegraded":"2023-09-28T00:22:59.706323+0000","last_fullsized":"2023-09-28T00:22:59.706323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:47.148310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717199+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:22:59.717199+0000","last_peered":"2023-09-28T00:22:59.717199+0000","last_clean":"2023-09-28T00:22:59.717199+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:22:59.717199+0000","last_undegraded":"2023-09-28T00:22:59.717199+0000","last_fullsized":"2023-09-28T00:22:59.717199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714969+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:22:59.714969+0000","last_peered":"2023-09-28T00:22:59.714969+0000","last_clean":"2023-09-28T00:22:59.714969+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:22:59.714969+0000","last_undegraded":"2023-09-28T00:22:59.714969+0000","last_fullsized":"2023-09-28T00:22:59.714969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707977+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:22:59.707977+0000","last_peered":"2023-09-28T00:22:59.707977+0000","last_clean":"2023-09-28T00:22:59.707977+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:22:59.707977+0000","last_undegraded":"2023-09-28T00:22:59.707977+0000","last_fullsized":"2023-09-28T00:22:59.707977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706336+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:22:59.706336+0000","last_peered":"2023-09-28T00:22:59.706336+0000","last_clean":"2023-09-28T00:22:59.706336+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:22:59.706336+0000","last_undegraded":"2023-09-28T00:22:59.706336+0000","last_fullsized":"2023-09-28T00:22:59.706336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:58:11.838522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.717656+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:22:59.717656+0000","last_peered":"2023-09-28T00:22:59.717656+0000","last_clean":"2023-09-28T00:22:59.717656+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:22:59.717656+0000","last_undegraded":"2023-09-28T00:22:59.717656+0000","last_fullsized":"2023-09-28T00:22:59.717656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713628+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:22:59.713628+0000","last_peered":"2023-09-28T00:22:59.713628+0000","last_clean":"2023-09-28T00:22:59.713628+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:22:59.713628+0000","last_undegraded":"2023-09-28T00:22:59.713628+0000","last_fullsized":"2023-09-28T00:22:59.713628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721596+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:23:04.721596+0000","last_peered":"2023-09-28T00:23:04.721596+0000","last_clean":"2023-09-28T00:23:04.721596+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:04.721596+0000","last_undegraded":"2023-09-28T00:23:04.721596+0000","last_fullsized":"2023-09-28T00:23:04.721596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721198+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721198+0000","last_peered":"2023-09-28T00:23:03.721198+0000","last_clean":"2023-09-28T00:23:03.721198+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721198+0000","last_undegraded":"2023-09-28T00:23:03.721198+0000","last_fullsized":"2023-09-28T00:23:03.721198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.717925+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:04.717925+0000","last_peered":"2023-09-28T00:23:04.717925+0000","last_clean":"2023-09-28T00:23:04.717925+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:04.717925+0000","last_undegraded":"2023-09-28T00:23:04.717925+0000","last_fullsized":"2023-09-28T00:23:04.717925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.710025+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.710025+0000","last_peered":"2023-09-28T00:23:02.710025+0000","last_clean":"2023-09-28T00:23:02.710025+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.710025+0000","last_undegraded":"2023-09-28T00:23:02.710025+0000","last_fullsized":"2023-09-28T00:23:02.710025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728314+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:23:05.728314+0000","last_peered":"2023-09-28T00:23:05.728314+0000","last_clean":"2023-09-28T00:23:05.728314+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:05.728314+0000","last_undegraded":"2023-09-28T00:23:05.728314+0000","last_fullsized":"2023-09-28T00:23:05.728314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.712814+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:02.712814+0000","last_peered":"2023-09-28T00:23:02.712814+0000","last_clean":"2023-09-28T00:23:02.712814+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:02.712814+0000","last_undegraded":"2023-09-28T00:23:02.712814+0000","last_fullsized":"2023-09-28T00:23:02.712814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728766+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728766+0000","last_peered":"2023-09-28T00:23:05.728766+0000","last_clean":"2023-09-28T00:23:05.728766+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728766+0000","last_undegraded":"2023-09-28T00:23:05.728766+0000","last_fullsized":"2023-09-28T00:23:05.728766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723035+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:22:59.723035+0000","last_peered":"2023-09-28T00:22:59.723035+0000","last_clean":"2023-09-28T00:22:59.723035+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:22:59.723035+0000","last_undegraded":"2023-09-28T00:22:59.723035+0000","last_fullsized":"2023-09-28T00:22:59.723035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:50.825972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726359+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726359+0000","last_peered":"2023-09-28T00:23:05.726359+0000","last_clean":"2023-09-28T00:23:05.726359+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726359+0000","last_undegraded":"2023-09-28T00:23:05.726359+0000","last_fullsized":"2023-09-28T00:23:05.726359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720017+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:04.720017+0000","last_peered":"2023-09-28T00:23:04.720017+0000","last_clean":"2023-09-28T00:23:04.720017+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:04.720017+0000","last_undegraded":"2023-09-28T00:23:04.720017+0000","last_fullsized":"2023-09-28T00:23:04.720017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722483+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:04.722483+0000","last_peered":"2023-09-28T00:23:04.722483+0000","last_clean":"2023-09-28T00:23:04.722483+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:04.722483+0000","last_undegraded":"2023-09-28T00:23:04.722483+0000","last_fullsized":"2023-09-28T00:23:04.722483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'17","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722261+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:23:04.722261+0000","last_peered":"2023-09-28T00:23:04.722261+0000","last_clean":"2023-09-28T00:23:04.722261+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:04.722261+0000","last_undegraded":"2023-09-28T00:23:04.722261+0000","last_fullsized":"2023-09-28T00:23:04.722261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:48:29.043817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188982+0000","last_change":"2023-09-28T00:22:59.218114+0000","last_active":"2023-09-28T00:23:02.188982+0000","last_peered":"2023-09-28T00:23:02.188982+0000","last_clean":"2023-09-28T00:23:02.188982+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:02.188982+0000","last_undegraded":"2023-09-28T00:23:02.188982+0000","last_fullsized":"2023-09-28T00:23:02.188982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728186+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:23:05.728186+0000","last_peered":"2023-09-28T00:23:05.728186+0000","last_clean":"2023-09-28T00:23:05.728186+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:05.728186+0000","last_undegraded":"2023-09-28T00:23:05.728186+0000","last_fullsized":"2023-09-28T00:23:05.728186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:11:10.689984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715645+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:22:59.715645+0000","last_peered":"2023-09-28T00:22:59.715645+0000","last_clean":"2023-09-28T00:22:59.715645+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:22:59.715645+0000","last_undegraded":"2023-09-28T00:22:59.715645+0000","last_fullsized":"2023-09-28T00:22:59.715645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:01:56.641274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721507+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:23:04.721507+0000","last_peered":"2023-09-28T00:23:04.721507+0000","last_clean":"2023-09-28T00:23:04.721507+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:04.721507+0000","last_undegraded":"2023-09-28T00:23:04.721507+0000","last_fullsized":"2023-09-28T00:23:04.721507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723111+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:22:59.723111+0000","last_peered":"2023-09-28T00:22:59.723111+0000","last_clean":"2023-09-28T00:22:59.723111+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:22:59.723111+0000","last_undegraded":"2023-09-28T00:22:59.723111+0000","last_fullsized":"2023-09-28T00:22:59.723111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:36:22.289514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718572+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:04.718572+0000","last_peered":"2023-09-28T00:23:04.718572+0000","last_clean":"2023-09-28T00:23:04.718572+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:04.718572+0000","last_undegraded":"2023-09-28T00:23:04.718572+0000","last_fullsized":"2023-09-28T00:23:04.718572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.714919+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:22:59.714919+0000","last_peered":"2023-09-28T00:22:59.714919+0000","last_clean":"2023-09-28T00:22:59.714919+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:22:59.714919+0000","last_undegraded":"2023-09-28T00:22:59.714919+0000","last_fullsized":"2023-09-28T00:22:59.714919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722580+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:04.722580+0000","last_peered":"2023-09-28T00:23:04.722580+0000","last_clean":"2023-09-28T00:23:04.722580+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:04.722580+0000","last_undegraded":"2023-09-28T00:23:04.722580+0000","last_fullsized":"2023-09-28T00:23:04.722580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725840+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725840+0000","last_peered":"2023-09-28T00:23:05.725840+0000","last_clean":"2023-09-28T00:23:05.725840+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725840+0000","last_undegraded":"2023-09-28T00:23:05.725840+0000","last_fullsized":"2023-09-28T00:23:05.725840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723139+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:22:59.723139+0000","last_peered":"2023-09-28T00:22:59.723139+0000","last_clean":"2023-09-28T00:22:59.723139+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:22:59.723139+0000","last_undegraded":"2023-09-28T00:22:59.723139+0000","last_fullsized":"2023-09-28T00:22:59.723139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:58:47.634120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720076+0000","last_change":"2023-09-28T00:22:59.201353+0000","last_active":"2023-09-28T00:23:04.720076+0000","last_peered":"2023-09-28T00:23:04.720076+0000","last_clean":"2023-09-28T00:23:04.720076+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:04.720076+0000","last_undegraded":"2023-09-28T00:23:04.720076+0000","last_fullsized":"2023-09-28T00:23:04.720076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:22:12.003508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720391+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:04.720391+0000","last_peered":"2023-09-28T00:23:04.720391+0000","last_clean":"2023-09-28T00:23:04.720391+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:04.720391+0000","last_undegraded":"2023-09-28T00:23:04.720391+0000","last_fullsized":"2023-09-28T00:23:04.720391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:45:17.501833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719030+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.719030+0000","last_peered":"2023-09-28T00:23:03.719030+0000","last_clean":"2023-09-28T00:23:03.719030+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.719030+0000","last_undegraded":"2023-09-28T00:23:03.719030+0000","last_fullsized":"2023-09-28T00:23:03.719030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691167+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:22:59.691167+0000","last_peered":"2023-09-28T00:22:59.691167+0000","last_clean":"2023-09-28T00:22:59.691167+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:22:59.691167+0000","last_undegraded":"2023-09-28T00:22:59.691167+0000","last_fullsized":"2023-09-28T00:22:59.691167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:06:57.625435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728787+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:05.728787+0000","last_peered":"2023-09-28T00:23:05.728787+0000","last_clean":"2023-09-28T00:23:05.728787+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:05.728787+0000","last_undegraded":"2023-09-28T00:23:05.728787+0000","last_fullsized":"2023-09-28T00:23:05.728787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719836+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.719836+0000","last_peered":"2023-09-28T00:23:03.719836+0000","last_clean":"2023-09-28T00:23:03.719836+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.719836+0000","last_undegraded":"2023-09-28T00:23:03.719836+0000","last_fullsized":"2023-09-28T00:23:03.719836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189439+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:23:02.189439+0000","last_peered":"2023-09-28T00:23:02.189439+0000","last_clean":"2023-09-28T00:23:02.189439+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:02.189439+0000","last_undegraded":"2023-09-28T00:23:02.189439+0000","last_fullsized":"2023-09-28T00:23:02.189439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722475+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:05.722475+0000","last_peered":"2023-09-28T00:23:05.722475+0000","last_clean":"2023-09-28T00:23:05.722475+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:05.722475+0000","last_undegraded":"2023-09-28T00:23:05.722475+0000","last_fullsized":"2023-09-28T00:23:05.722475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718240+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:04.718240+0000","last_peered":"2023-09-28T00:23:04.718240+0000","last_clean":"2023-09-28T00:23:04.718240+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:04.718240+0000","last_undegraded":"2023-09-28T00:23:04.718240+0000","last_fullsized":"2023-09-28T00:23:04.718240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722920+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:22:59.722920+0000","last_peered":"2023-09-28T00:22:59.722920+0000","last_clean":"2023-09-28T00:22:59.722920+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:22:59.722920+0000","last_undegraded":"2023-09-28T00:22:59.722920+0000","last_fullsized":"2023-09-28T00:22:59.722920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:17:17.205283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725530+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:23:05.725530+0000","last_peered":"2023-09-28T00:23:05.725530+0000","last_clean":"2023-09-28T00:23:05.725530+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:05.725530+0000","last_undegraded":"2023-09-28T00:23:05.725530+0000","last_fullsized":"2023-09-28T00:23:05.725530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:18.496201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710487+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:22:59.710487+0000","last_peered":"2023-09-28T00:22:59.710487+0000","last_clean":"2023-09-28T00:22:59.710487+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:22:59.710487+0000","last_undegraded":"2023-09-28T00:22:59.710487+0000","last_fullsized":"2023-09-28T00:22:59.710487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:12.931747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'12","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.727227+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:05.727227+0000","last_peered":"2023-09-28T00:23:05.727227+0000","last_clean":"2023-09-28T00:23:05.727227+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:05.727227+0000","last_undegraded":"2023-09-28T00:23:05.727227+0000","last_fullsized":"2023-09-28T00:23:05.727227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712741+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:22:59.712741+0000","last_peered":"2023-09-28T00:22:59.712741+0000","last_clean":"2023-09-28T00:22:59.712741+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:22:59.712741+0000","last_undegraded":"2023-09-28T00:22:59.712741+0000","last_fullsized":"2023-09-28T00:22:59.712741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:50:52.556198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'13","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725695+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:05.725695+0000","last_peered":"2023-09-28T00:23:05.725695+0000","last_clean":"2023-09-28T00:23:05.725695+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:05.725695+0000","last_undegraded":"2023-09-28T00:23:05.725695+0000","last_fullsized":"2023-09-28T00:23:05.725695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710691+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:22:59.710691+0000","last_peered":"2023-09-28T00:22:59.710691+0000","last_clean":"2023-09-28T00:22:59.710691+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:22:59.710691+0000","last_undegraded":"2023-09-28T00:22:59.710691+0000","last_fullsized":"2023-09-28T00:22:59.710691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:21:11.996023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706526+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:22:59.706526+0000","last_peered":"2023-09-28T00:22:59.706526+0000","last_clean":"2023-09-28T00:22:59.706526+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:22:59.706526+0000","last_undegraded":"2023-09-28T00:22:59.706526+0000","last_fullsized":"2023-09-28T00:22:59.706526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:06:45.419665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.724822+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:22:59.724822+0000","last_peered":"2023-09-28T00:22:59.724822+0000","last_clean":"2023-09-28T00:22:59.724822+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:22:59.724822+0000","last_undegraded":"2023-09-28T00:22:59.724822+0000","last_fullsized":"2023-09-28T00:22:59.724822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13284,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358556,"statfs":{"total":96636764160,"available":96623161344,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8088,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363752,"statfs":{"total":96636764160,"available":96628482048,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:25.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:23:25.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.610+0000 7f1d7b39d700 1 Processor -- start 2023-09-28T00:23:25.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.610+0000 7f1d7b39d700 1 -- start start 2023-09-28T00:23:25.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d7b39d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d74156680 0x7f1d740c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d7b39d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740c6c10 con 0x7f1d74155d00 2023-09-28T00:23:25.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d7b39d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740c5d20 con 0x7f1d741560d0 2023-09-28T00:23:25.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d7b39d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740c6000 con 0x7f1d74156680 2023-09-28T00:23:25.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d7a39b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1d74155d00 0x7f1d740c4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41174/0 (socket says 172.21.15.53:41174) 2023-09-28T00:23:25.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d7a39b700 1 -- 172.21.15.53:0/4277745746 learned_addr learned my addr 172.21.15.53:0/4277745746 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:25.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.611+0000 7f1d79b9a700 1 --2- 172.21.15.53:0/4277745746 >> v2:172.21.15.118:3300/0 conn(0x7f1d74156680 0x7f1d740c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091096176 0 0) 0x7f1d740c5d20 con 0x7f1d741560d0 2023-09-28T00:23:25.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d60003570 con 0x7f1d741560d0 2023-09-28T00:23:25.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387410686 0 0) 0x7f1d740c6c10 con 0x7f1d74155d00 2023-09-28T00:23:25.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d740c5d20 con 0x7f1d74155d00 2023-09-28T00:23:25.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79b9a700 1 -- 172.21.15.53:0/4277745746 >> v1:172.21.15.118:6789/0 conn(0x7f1d741560d0 legacy=0x7f1d74152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79b9a700 1 -- 172.21.15.53:0/4277745746 >> v1:172.21.15.53:6789/0 conn(0x7f1d74155d00 legacy=0x7f1d740c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79b9a700 1 -- 172.21.15.53:0/4277745746 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740c62e0 con 0x7f1d74156680 2023-09-28T00:23:25.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79b9a700 1 --2- 172.21.15.53:0/4277745746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d740c04b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d640098e0 tx=0x7f1d640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf4799758e3fb3c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64011630 con 0x7f1d74156680 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64011790 con 0x7f1d74156680 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.612+0000 7f1d79399700 1 -- 172.21.15.53:0/4277745746 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64011b30 con 0x7f1d74156680 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 -- 172.21.15.53:0/4277745746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 msgr2=0x7f1d740c04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/4277745746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d740c04b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d640098e0 tx=0x7f1d640091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 -- 172.21.15.53:0/4277745746 shutdown_connections 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/4277745746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d740c04b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 -- 172.21.15.53:0/4277745746 >> 172.21.15.53:0/4277745746 conn(0x7f1d74067630 msgr2=0x7f1d74067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:25.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 -- 172.21.15.53:0/4277745746 shutdown_connections 2023-09-28T00:23:25.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.613+0000 7f1d7b39d700 1 -- 172.21.15.53:0/4277745746 wait complete. 2023-09-28T00:23:25.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.615+0000 7f1d7b39d700 1 Processor -- start 2023-09-28T00:23:25.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.615+0000 7f1d7b39d700 1 -- start start 2023-09-28T00:23:25.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7b39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 0x7f1d74165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7b39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d741560d0 0x7f1d7414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7b39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d74147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7b39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74169290 con 0x7f1d74155d00 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7b39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74169570 con 0x7f1d74156680 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7b39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74169850 con 0x7f1d741560d0 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 0x7f1d74165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 0x7f1d74165fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48502/0 (socket says 172.21.15.53:48502) 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 -- 172.21.15.53:0/779760401 learned_addr learned my addr 172.21.15.53:0/779760401 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d79b9a700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d741560d0 0x7f1d7414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7ab9c700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d74147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 -- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d741560d0 msgr2=0x7f1d7414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d741560d0 0x7f1d7414bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 -- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 msgr2=0x7f1d74147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d74147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.616+0000 7f1d7a39b700 1 -- 172.21.15.53:0/779760401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64009420 con 0x7f1d74155d00 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.617+0000 7f1d7a39b700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 0x7f1d74165fc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c7c0 tx=0x7f1d70007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:25.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.617+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70005b30 con 0x7f1d74155d00 2023-09-28T00:23:25.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.617+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d70005c90 con 0x7f1d74155d00 2023-09-28T00:23:25.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.617+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d74169b30 con 0x7f1d74155d00 2023-09-28T00:23:25.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.617+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70007320 con 0x7f1d74155d00 2023-09-28T00:23:25.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.617+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d740c40b0 con 0x7f1d74155d00 2023-09-28T00:23:25.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.618+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d74165ce0 con 0x7f1d74155d00 2023-09-28T00:23:25.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.619+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1d7001b3b0 con 0x7f1d74155d00 2023-09-28T00:23:25.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.620+0000 7f1d6a7fc700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d58067330 0x7f1d580697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:25.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.620+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d70084180 con 0x7f1d74155d00 2023-09-28T00:23:25.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.620+0000 7f1d79b9a700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d58067330 0x7f1d580697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:25.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.621+0000 7f1d79b9a700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d58067330 0x7f1d580697e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d640098e0 tx=0x7f1d64017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:25.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.624+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1d74165ce0 con 0x7f1d74155d00 2023-09-28T00:23:25.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.830+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7404c3c0 con 0x7f1d74155d00 2023-09-28T00:23:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.831+0000 7f1d6a7fc700 1 -- 172.21.15.53:0/779760401 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f1d70050fe0 con 0x7f1d74155d00 2023-09-28T00:23:25.833 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:25.834 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:23:25.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.833+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d58067330 msgr2=0x7f1d580697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.833+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d58067330 0x7f1d580697e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d640098e0 tx=0x7f1d64017000 comp rx=0 tx=0).stop 2023-09-28T00:23:25.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.833+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 msgr2=0x7f1d74165fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:25.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.833+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 0x7f1d74165fc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c7c0 tx=0x7f1d70007e80 comp rx=0 tx=0).stop 2023-09-28T00:23:25.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 shutdown_connections 2023-09-28T00:23:25.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d58067330 0x7f1d580697e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d74156680 0x7f1d74147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d74155d00 0x7f1d74165fc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 --2- 172.21.15.53:0/779760401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d741560d0 0x7f1d7414bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:25.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 >> 172.21.15.53:0/779760401 conn(0x7f1d74067630 msgr2=0x7f1d7406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:25.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 shutdown_connections 2023-09-28T00:23:25.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:25.834+0000 7f1d7b39d700 1 -- 172.21.15.53:0/779760401 wait complete. 2023-09-28T00:23:26.852 INFO:tasks.ceph:Scrubbing osd.0 2023-09-28T00:23:26.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:27.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.055+0000 7f535db9d700 1 Processor -- start 2023-09-28T00:23:27.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.055+0000 7f535db9d700 1 -- start start 2023-09-28T00:23:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.056+0000 7f535db9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535814fc00 0x7f5358155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f535db9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580c5bc0 con 0x7f53580c8c90 2023-09-28T00:23:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f535db9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535806c900 con 0x7f53580bfeb0 2023-09-28T00:23:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f535db9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53580c0820 con 0x7f535814fc00 2023-09-28T00:23:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f535cb9b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f53580c8c90 0x7f535814f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59650/0 (socket says 172.21.15.53:59650) 2023-09-28T00:23:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f535cb9b700 1 -- 172.21.15.53:0/3370598013 learned_addr learned my addr 172.21.15.53:0/3370598013 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f5357fff700 1 --2- 172.21.15.53:0/3370598013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535814fc00 0x7f5358155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770303544 0 0) 0x7f53580c5bc0 con 0x7f53580c8c90 2023-09-28T00:23:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5348003570 con 0x7f53580c8c90 2023-09-28T00:23:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710125065 0 0) 0x7f535806c900 con 0x7f53580bfeb0 2023-09-28T00:23:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53580c5bc0 con 0x7f53580bfeb0 2023-09-28T00:23:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f5357fff700 1 -- 172.21.15.53:0/3370598013 >> v1:172.21.15.118:6789/0 conn(0x7f53580bfeb0 legacy=0x7f535815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f5357fff700 1 -- 172.21.15.53:0/3370598013 >> v1:172.21.15.53:6789/0 conn(0x7f53580c8c90 legacy=0x7f535814f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.057+0000 7f5357fff700 1 -- 172.21.15.53:0/3370598013 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535806cbe0 con 0x7f535814fc00 2023-09-28T00:23:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.058+0000 7f5357fff700 1 --2- 172.21.15.53:0/3370598013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535814fc00 0x7f5358155980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5344009910 tx=0x7f53440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea930b2d8d3d4667 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.058+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400b690 con 0x7f535814fc00 2023-09-28T00:23:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.058+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534400b7f0 con 0x7f535814fc00 2023-09-28T00:23:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.058+0000 7f53577fe700 1 -- 172.21.15.53:0/3370598013 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400bb90 con 0x7f535814fc00 2023-09-28T00:23:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.058+0000 7f535db9d700 1 -- 172.21.15.53:0/3370598013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535814fc00 msgr2=0x7f5358155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.058+0000 7f535db9d700 1 --2- 172.21.15.53:0/3370598013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535814fc00 0x7f5358155980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5344009910 tx=0x7f53440091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.059+0000 7f535db9d700 1 -- 172.21.15.53:0/3370598013 shutdown_connections 2023-09-28T00:23:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.059+0000 7f535db9d700 1 --2- 172.21.15.53:0/3370598013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535814fc00 0x7f5358155980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.059+0000 7f535db9d700 1 -- 172.21.15.53:0/3370598013 >> 172.21.15.53:0/3370598013 conn(0x7f5358070540 msgr2=0x7f535806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.059+0000 7f535db9d700 1 -- 172.21.15.53:0/3370598013 shutdown_connections 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.059+0000 7f535db9d700 1 -- 172.21.15.53:0/3370598013 wait complete. 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.060+0000 7f535db9d700 1 Processor -- start 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.060+0000 7f535db9d700 1 -- start start 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535db9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53580bfeb0 0x7f5358150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535db9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53580c8c90 0x7f5358151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535db9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535814fc00 0x7f5358141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535db9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535813fbc0 con 0x7f53580c8c90 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535db9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5358150b30 con 0x7f535814fc00 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535db9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53581415e0 con 0x7f53580bfeb0 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f5357fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53580c8c90 0x7f5358151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535cb9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53580bfeb0 0x7f5358150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f5357fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53580c8c90 0x7f5358151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40870/0 (socket says 172.21.15.53:40870) 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f5357fff700 1 -- 172.21.15.53:0/625229666 learned_addr learned my addr 172.21.15.53:0/625229666 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.061+0000 7f535d39c700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535814fc00 0x7f5358141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5357fff700 1 -- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53580bfeb0 msgr2=0x7f5358150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5357fff700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53580bfeb0 0x7f5358150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5357fff700 1 -- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535814fc00 msgr2=0x7f5358141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5357fff700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535814fc00 0x7f5358141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5357fff700 1 -- 172.21.15.53:0/625229666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5344009420 con 0x7f53580c8c90 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f535cb9b700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53580bfeb0 0x7f5358150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5357fff700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53580c8c90 0x7f5358151460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5344013000 tx=0x7f5344017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534401f070 con 0x7f53580c8c90 2023-09-28T00:23:27.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344002f70 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53580c22e0 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.062+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400b960 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.063+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53581418c0 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.063+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5358144420 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.064+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5344023070 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.065+0000 7f5354ff9700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f533c067360 0x7f533c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.065+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5344085b30 con 0x7f53580c8c90 2023-09-28T00:23:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.065+0000 7f5354ff9700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7f533c06fc10 0x7f533c072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.065+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 --> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f533c0726d0 con 0x7f533c06fc10 2023-09-28T00:23:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.065+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f534408a220 con 0x7f53580c8c90 2023-09-28T00:23:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.066+0000 7f535cb9b700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f533c067360 0x7f533c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.066+0000 7f535d39c700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7f533c06fc10 0x7f533c072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.066+0000 7f535d39c700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7f533c06fc10 0x7f533c072020 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.066+0000 7f535cb9b700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f533c067360 0x7f533c069810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f534c007fd0 tx=0x7f534c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.067+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== osd.0 v2:172.21.15.53:6800/85093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f533c0726d0 con 0x7f533c06fc10 2023-09-28T00:23:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.081+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 --> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f535813f940 con 0x7f533c06fc10 2023-09-28T00:23:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f5354ff9700 1 -- 172.21.15.53:0/625229666 <== osd.0 v2:172.21.15.53:6800/85093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f535813f940 con 0x7f533c06fc10 2023-09-28T00:23:27.082 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:27.082 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:27.082 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7f533c06fc10 msgr2=0x7f533c072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:6800/85093,v1:172.21.15.53:6801/85093] conn(0x7f533c06fc10 0x7f533c072020 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f533c067360 msgr2=0x7f533c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f533c067360 0x7f533c069810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f534c007fd0 tx=0x7f534c009040 comp rx=0 tx=0).stop 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53580c8c90 msgr2=0x7f5358151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 --2- 172.21.15.53:0/625229666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53580c8c90 0x7f5358151460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5344013000 tx=0x7f5344017000 comp rx=0 tx=0).stop 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535d39c700 1 -- 172.21.15.53:0/625229666 reap_dead start 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 shutdown_connections 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 >> 172.21.15.53:0/625229666 conn(0x7f5358070540 msgr2=0x7f535806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 shutdown_connections 2023-09-28T00:23:27.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.082+0000 7f535db9d700 1 -- 172.21.15.53:0/625229666 wait complete. 2023-09-28T00:23:27.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-28T00:23:27.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.288+0000 7f1d7699d700 1 Processor -- start 2023-09-28T00:23:27.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.288+0000 7f1d7699d700 1 -- start start 2023-09-28T00:23:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.289+0000 7f1d7699d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.289+0000 7f1d7699d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d70156040 con 0x7f1d700c0e10 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.289+0000 7f1d7699d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700c6cf0 con 0x7f1d700c11e0 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.289+0000 7f1d7699d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700c6730 con 0x7f1d7013ed20 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d7599b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1d700c0e10 0x7f1d7013e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59656/0 (socket says 172.21.15.53:59656) 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d7599b700 1 -- 172.21.15.53:0/2313655498 learned_addr learned my addr 172.21.15.53:0/2313655498 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d7619c700 1 --2- 172.21.15.53:0/2313655498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307000645 0 0) 0x7f1d70156040 con 0x7f1d700c0e10 2023-09-28T00:23:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5c003570 con 0x7f1d700c0e10 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7613290 0 0) 0x7f1d700c6cf0 con 0x7f1d700c11e0 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d70156040 con 0x7f1d700c11e0 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d7619c700 1 -- 172.21.15.53:0/2313655498 >> v1:172.21.15.118:6789/0 conn(0x7f1d700c11e0 legacy=0x7f1d7015e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d7619c700 1 -- 172.21.15.53:0/2313655498 >> v1:172.21.15.53:6789/0 conn(0x7f1d700c0e10 legacy=0x7f1d7013e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.290+0000 7f1d7619c700 1 -- 172.21.15.53:0/2313655498 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700c6a10 con 0x7f1d7013ed20 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7619c700 1 --2- 172.21.15.53:0/2313655498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70159840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009e90 tx=0x7f1d68009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f116c38656a621d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800e070 con 0x7f1d7013ed20 2023-09-28T00:23:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6800bb80 con 0x7f1d7013ed20 2023-09-28T00:23:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d74999700 1 -- 172.21.15.53:0/2313655498 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68012430 con 0x7f1d7013ed20 2023-09-28T00:23:27.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 -- 172.21.15.53:0/2313655498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 msgr2=0x7f1d70159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 --2- 172.21.15.53:0/2313655498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70159840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009e90 tx=0x7f1d68009780 comp rx=0 tx=0).stop 2023-09-28T00:23:27.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 -- 172.21.15.53:0/2313655498 shutdown_connections 2023-09-28T00:23:27.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 --2- 172.21.15.53:0/2313655498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70159840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 -- 172.21.15.53:0/2313655498 >> 172.21.15.53:0/2313655498 conn(0x7f1d7006f830 msgr2=0x7f1d700cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 -- 172.21.15.53:0/2313655498 shutdown_connections 2023-09-28T00:23:27.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.291+0000 7f1d7699d700 1 -- 172.21.15.53:0/2313655498 wait complete. 2023-09-28T00:23:27.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.293+0000 7f1d7699d700 1 Processor -- start 2023-09-28T00:23:27.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.293+0000 7f1d7699d700 1 -- start start 2023-09-28T00:23:27.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7699d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 0x7f1d700ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7699d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d700c11e0 0x7f1d70169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7699d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7699d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70158190 con 0x7f1d700c0e10 2023-09-28T00:23:27.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7699d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700acef0 con 0x7f1d700c11e0 2023-09-28T00:23:27.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7699d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700ad9b0 con 0x7f1d7013ed20 2023-09-28T00:23:27.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7599b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 0x7f1d700ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7599b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 0x7f1d700ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40872/0 (socket says 172.21.15.53:40872) 2023-09-28T00:23:27.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7599b700 1 -- 172.21.15.53:0/1509555400 learned_addr learned my addr 172.21.15.53:0/1509555400 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:27.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7519a700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d700c11e0 0x7f1d70169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.294+0000 7f1d7619c700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7599b700 1 -- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 msgr2=0x7f1d70157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7599b700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7599b700 1 -- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d700c11e0 msgr2=0x7f1d70169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7599b700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d700c11e0 0x7f1d70169540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7599b700 1 -- 172.21.15.53:0/1509555400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009a20 con 0x7f1d700c0e10 2023-09-28T00:23:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7599b700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 0x7f1d700ad380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c790 tx=0x7f1d6c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c005b30 con 0x7f1d700c0e10 2023-09-28T00:23:27.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c005cd0 con 0x7f1d700c0e10 2023-09-28T00:23:27.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c007320 con 0x7f1d700c0e10 2023-09-28T00:23:27.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d700adc90 con 0x7f1d700c0e10 2023-09-28T00:23:27.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.295+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d700acb80 con 0x7f1d700c0e10 2023-09-28T00:23:27.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.296+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d700ac700 con 0x7f1d700c0e10 2023-09-28T00:23:27.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.297+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1d6c012400 con 0x7f1d700c0e10 2023-09-28T00:23:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.298+0000 7f1d65ffb700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d54067330 0x7f1d540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.298+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d6c083ff0 con 0x7f1d700c0e10 2023-09-28T00:23:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.298+0000 7f1d7519a700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d54067330 0x7f1d540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.299+0000 7f1d7519a700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d54067330 0x7f1d540697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d7013d4e0 tx=0x7f1d60007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.302+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1d6c04b570 con 0x7f1d700c0e10 2023-09-28T00:23:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.505+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d700ad1d0 con 0x7f1d54067330 2023-09-28T00:23:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.506+0000 7f1d65ffb700 1 -- 172.21.15.53:0/1509555400 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1d700ad1d0 con 0x7f1d54067330 2023-09-28T00:23:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d54067330 msgr2=0x7f1d540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d54067330 0x7f1d540697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d7013d4e0 tx=0x7f1d60007d50 comp rx=0 tx=0).stop 2023-09-28T00:23:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 msgr2=0x7f1d700ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 0x7f1d700ad380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c790 tx=0x7f1d6c007e80 comp rx=0 tx=0).stop 2023-09-28T00:23:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 shutdown_connections 2023-09-28T00:23:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f1d54067330 0x7f1d540697e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d7013ed20 0x7f1d70157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d700c0e10 0x7f1d700ad380 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 --2- 172.21.15.53:0/1509555400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d700c11e0 0x7f1d70169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 >> 172.21.15.53:0/1509555400 conn(0x7f1d7006f830 msgr2=0x7f1d70069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 shutdown_connections 2023-09-28T00:23:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.508+0000 7f1d7699d700 1 -- 172.21.15.53:0/1509555400 wait complete. 2023-09-28T00:23:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2023-09-28T00:23:27.525 INFO:tasks.ceph:Scrubbing osd.1 2023-09-28T00:23:27.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:27.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.716+0000 7fe18639d700 1 Processor -- start 2023-09-28T00:23:27.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.716+0000 7fe18639d700 1 -- start start 2023-09-28T00:23:27.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe18639d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1800c8cb0 0x7fe1800c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe18639d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c9080 0x7fe180160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe18639d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe180158d00 con 0x7fe1800c5880 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe18639d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800679b0 con 0x7fe1800c8cb0 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe18639d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180158f70 con 0x7fe1800c9080 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe18539b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1800c8cb0 0x7fe1800c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe184b9a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe1800c5880 0x7fe18014f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:33304/0 (socket says 172.21.15.53:33304) 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe184b9a700 1 -- 172.21.15.53:0/2112846978 learned_addr learned my addr 172.21.15.53:0/2112846978 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.717+0000 7fe185b9c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c9080 0x7fe180160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe177fff700 1 -- 172.21.15.53:0/2112846978 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103997661 0 0) 0x7fe180158d00 con 0x7fe1800c5880 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe177fff700 1 -- 172.21.15.53:0/2112846978 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c003570 con 0x7fe1800c5880 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe18539b700 1 -- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c9080 msgr2=0x7fe180160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe18539b700 1 --2- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c9080 0x7fe180160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe18539b700 1 -- 172.21.15.53:0/2112846978 >> v1:172.21.15.118:6789/0 conn(0x7fe1800c5880 legacy=0x7fe18014f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe18539b700 1 -- 172.21.15.53:0/2112846978 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180159250 con 0x7fe1800c8cb0 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe185b9c700 1 --2- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c9080 0x7fe180160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe18539b700 1 --2- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c5340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0098e0 tx=0x7fe17c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3591fd0bb0b103b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe177fff700 1 -- 172.21.15.53:0/2112846978 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c011630 con 0x7fe1800c8cb0 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.718+0000 7fe177fff700 1 -- 172.21.15.53:0/2112846978 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c011790 con 0x7fe1800c8cb0 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe177fff700 1 -- 172.21.15.53:0/2112846978 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c011b10 con 0x7fe1800c8cb0 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 -- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 msgr2=0x7fe1800c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 --2- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c5340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0098e0 tx=0x7fe17c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 -- 172.21.15.53:0/2112846978 shutdown_connections 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 --2- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c9080 0x7fe180160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 --2- 172.21.15.53:0/2112846978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c5340 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 -- 172.21.15.53:0/2112846978 >> 172.21.15.53:0/2112846978 conn(0x7fe180070540 msgr2=0x7fe18006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 -- 172.21.15.53:0/2112846978 shutdown_connections 2023-09-28T00:23:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.719+0000 7fe18639d700 1 -- 172.21.15.53:0/2112846978 wait complete. 2023-09-28T00:23:27.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.721+0000 7fe18639d700 1 Processor -- start 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.721+0000 7fe18639d700 1 -- start start 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18639d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c5880 0x7fe180145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18639d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18639d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1800c9080 0x7fe180169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18639d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801480e0 con 0x7fe1800c9080 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18639d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180147510 con 0x7fe1800c8cb0 2023-09-28T00:23:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18639d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801477b0 con 0x7fe1800c5880 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c5880 0x7fe180145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe184b9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c5880 0x7fe180145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:34156/0 (socket says 172.21.15.53:34156) 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 -- 172.21.15.53:0/57682158 learned_addr learned my addr 172.21.15.53:0/57682158 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe185b9c700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1800c9080 0x7fe180169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 -- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 msgr2=0x7fe1800c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 -- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1800c9080 msgr2=0x7fe180169120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1800c9080 0x7fe180169120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe18539b700 1 -- 172.21.15.53:0/57682158 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009a20 con 0x7fe1800c5880 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.722+0000 7fe184b9a700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1800c8cb0 0x7fe1800c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.723+0000 7fe18539b700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c5880 0x7fe180145c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1800c65d0 tx=0x7fe17c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.723+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c011b10 con 0x7fe1800c5880 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.723+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c000c90 con 0x7fe1800c5880 2023-09-28T00:23:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.723+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c01a660 con 0x7fe1800c5880 2023-09-28T00:23:27.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.723+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c009420 con 0x7fe1800c5880 2023-09-28T00:23:27.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.723+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe180147d70 con 0x7fe1800c5880 2023-09-28T00:23:27.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.724+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe180071830 con 0x7fe1800c5880 2023-09-28T00:23:27.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.725+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe17c01aa50 con 0x7fe1800c5880 2023-09-28T00:23:27.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe1757fa700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe164067360 0x7fe164069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe17c086420 con 0x7fe1800c5880 2023-09-28T00:23:27.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe1757fa700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fe16406fc10 0x7fe164072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 --> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1640726d0 con 0x7fe16406fc10 2023-09-28T00:23:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe17c086710 con 0x7fe1800c5880 2023-09-28T00:23:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe184b9a700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe164067360 0x7fe164069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.726+0000 7fe185b9c700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fe16406fc10 0x7fe164072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.727+0000 7fe184b9a700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe164067360 0x7fe164069810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe180064950 tx=0x7fe170009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.727+0000 7fe185b9c700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fe16406fc10 0x7fe164072020 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.728+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== osd.1 v2:172.21.15.53:6802/85092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe1640726d0 con 0x7fe16406fc10 2023-09-28T00:23:27.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.742+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 --> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe180159530 con 0x7fe16406fc10 2023-09-28T00:23:27.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.742+0000 7fe1757fa700 1 -- 172.21.15.53:0/57682158 <== osd.1 v2:172.21.15.53:6802/85092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe180159530 con 0x7fe16406fc10 2023-09-28T00:23:27.743 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:27.743 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:27.743 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:27.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fe16406fc10 msgr2=0x7fe164072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.53:6802/85092,v1:172.21.15.53:6804/85092] conn(0x7fe16406fc10 0x7fe164072020 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe164067360 msgr2=0x7fe164069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe164067360 0x7fe164069810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe180064950 tx=0x7fe170009040 comp rx=0 tx=0).stop 2023-09-28T00:23:27.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c5880 msgr2=0x7fe180145c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 --2- 172.21.15.53:0/57682158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1800c5880 0x7fe180145c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1800c65d0 tx=0x7fe17c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:27.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe185b9c700 1 -- 172.21.15.53:0/57682158 reap_dead start 2023-09-28T00:23:27.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 shutdown_connections 2023-09-28T00:23:27.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 >> 172.21.15.53:0/57682158 conn(0x7fe180070540 msgr2=0x7fe18006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 shutdown_connections 2023-09-28T00:23:27.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.743+0000 7fe18639d700 1 -- 172.21.15.53:0/57682158 wait complete. 2023-09-28T00:23:27.759 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-28T00:23:27.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.948+0000 7f5cfcf9d700 1 Processor -- start 2023-09-28T00:23:27.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.948+0000 7f5cfcf9d700 1 -- start start 2023-09-28T00:23:27.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.949+0000 7f5cfcf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf80c11e0 0x7f5cf8159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.949+0000 7f5cfcf9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf8156040 con 0x7f5cf80c0e10 2023-09-28T00:23:27.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cfcf9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80c6cf0 con 0x7f5cf813ed20 2023-09-28T00:23:27.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cfcf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c6730 con 0x7f5cf80c11e0 2023-09-28T00:23:27.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf77fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5cf80c0e10 0x7f5cf813e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59664/0 (socket says 172.21.15.53:59664) 2023-09-28T00:23:27.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf77fe700 1 -- 172.21.15.53:0/3520978661 learned_addr learned my addr 172.21.15.53:0/3520978661 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:27.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf6ffd700 1 --2- 172.21.15.53:0/3520978661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf80c11e0 0x7f5cf8159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf67fc700 1 -- 172.21.15.53:0/3520978661 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942750534 0 0) 0x7f5cf8156040 con 0x7f5cf80c0e10 2023-09-28T00:23:27.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf67fc700 1 -- 172.21.15.53:0/3520978661 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ce0003570 con 0x7f5cf80c0e10 2023-09-28T00:23:27.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/3520978661 >> v1:172.21.15.118:6789/0 conn(0x7f5cf813ed20 legacy=0x7f5cf81601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf67fc700 1 -- 172.21.15.53:0/3520978661 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376461800 0 0) 0x7f5cf80c6cf0 con 0x7f5cf813ed20 2023-09-28T00:23:27.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/3520978661 >> v1:172.21.15.53:6789/0 conn(0x7f5cf80c0e10 legacy=0x7f5cf813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.950+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/3520978661 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80c6a10 con 0x7f5cf80c11e0 2023-09-28T00:23:27.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cf6ffd700 1 --2- 172.21.15.53:0/3520978661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf80c11e0 0x7f5cf8159840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009940 tx=0x7f5cec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3668e46c673647f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cf67fc700 1 -- 172.21.15.53:0/3520978661 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00b670 con 0x7f5cf80c11e0 2023-09-28T00:23:27.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cf67fc700 1 -- 172.21.15.53:0/3520978661 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00b7d0 con 0x7f5cf80c11e0 2023-09-28T00:23:27.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cf67fc700 1 -- 172.21.15.53:0/3520978661 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00bb90 con 0x7f5cf80c11e0 2023-09-28T00:23:27.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/3520978661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf80c11e0 msgr2=0x7f5cf8159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/3520978661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf80c11e0 0x7f5cf8159840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009940 tx=0x7f5cec0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/3520978661 shutdown_connections 2023-09-28T00:23:27.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/3520978661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf80c11e0 0x7f5cf8159840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.951+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/3520978661 >> 172.21.15.53:0/3520978661 conn(0x7f5cf806f830 msgr2=0x7f5cf80cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:27.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.952+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/3520978661 shutdown_connections 2023-09-28T00:23:27.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.952+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/3520978661 wait complete. 2023-09-28T00:23:27.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.953+0000 7f5cfcf9d700 1 Processor -- start 2023-09-28T00:23:27.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.953+0000 7f5cfcf9d700 1 -- start start 2023-09-28T00:23:27.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cfcf9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf80c0e10 0x7f5cf80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cfcf9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 0x7f5cf81583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cfcf9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf813ed20 0x7f5cf81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cfcf9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8157f10 con 0x7f5cf80c11e0 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cfcf9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8157c30 con 0x7f5cf80c0e10 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cfcf9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8165ae0 con 0x7f5cf813ed20 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cf6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 0x7f5cf81583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cf6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 0x7f5cf81583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40884/0 (socket says 172.21.15.53:40884) 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/24836218 learned_addr learned my addr 172.21.15.53:0/24836218 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cf77fe700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf80c0e10 0x7f5cf80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.954+0000 7f5cf7fff700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf813ed20 0x7f5cf81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf813ed20 msgr2=0x7f5cf81588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cf6ffd700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf813ed20 0x7f5cf81588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf80c0e10 msgr2=0x7f5cf80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cf6ffd700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf80c0e10 0x7f5cf80cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cf6ffd700 1 -- 172.21.15.53:0/24836218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009420 con 0x7f5cf80c11e0 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cf6ffd700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 0x7f5cf81583a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0093f0 tx=0x7f5cec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec01f070 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec000bc0 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf8165dc0 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00bb90 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.955+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf8166380 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.956+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf81580c0 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.957+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5cec023070 con 0x7f5cf80c11e0 2023-09-28T00:23:27.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.958+0000 7f5cdf7fe700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ce4067330 0x7f5ce40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:27.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.958+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5cec085fc0 con 0x7f5cf80c11e0 2023-09-28T00:23:27.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.958+0000 7f5cf77fe700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ce4067330 0x7f5ce40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:27.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.959+0000 7f5cf77fe700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ce4067330 0x7f5ce40697e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007fd0 tx=0x7f5ce8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:27.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:27.962+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5cf81580c0 con 0x7f5cf80c11e0 2023-09-28T00:23:28.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.162+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cf81580c0 con 0x7f5ce4067330 2023-09-28T00:23:28.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.163+0000 7f5cdf7fe700 1 -- 172.21.15.53:0/24836218 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5cf81580c0 con 0x7f5ce4067330 2023-09-28T00:23:28.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ce4067330 msgr2=0x7f5ce40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ce4067330 0x7f5ce40697e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007fd0 tx=0x7f5ce8009040 comp rx=0 tx=0).stop 2023-09-28T00:23:28.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 msgr2=0x7f5cf81583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 0x7f5cf81583a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0093f0 tx=0x7f5cec017000 comp rx=0 tx=0).stop 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 shutdown_connections 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ce4067330 0x7f5ce40697e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cf813ed20 0x7f5cf81588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cf80c0e10 0x7f5cf80cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 --2- 172.21.15.53:0/24836218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cf80c11e0 0x7f5cf81583a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 >> 172.21.15.53:0/24836218 conn(0x7f5cf806f830 msgr2=0x7f5cf8069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 shutdown_connections 2023-09-28T00:23:28.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.165+0000 7f5cfcf9d700 1 -- 172.21.15.53:0/24836218 wait complete. 2023-09-28T00:23:28.167 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2023-09-28T00:23:28.182 INFO:tasks.ceph:Scrubbing osd.2 2023-09-28T00:23:28.183 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:28.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.375+0000 7f3ef199d700 1 Processor -- start 2023-09-28T00:23:28.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.375+0000 7f3ef199d700 1 -- start start 2023-09-28T00:23:28.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef199d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef199d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec06cd30 con 0x7f3eec0c47c0 2023-09-28T00:23:28.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef199d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0c1590 con 0x7f3eec14d760 2023-09-28T00:23:28.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef199d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c1260 con 0x7f3eec1570e0 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3eebfff700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3eec0c47c0 0x7f3eec1574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59680/0 (socket says 172.21.15.53:59680) 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3eebfff700 1 -- 172.21.15.53:0/3674237219 learned_addr learned my addr 172.21.15.53:0/3674237219 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef119c700 1 --1- 172.21.15.53:0/3674237219 >> v1:172.21.15.118:6789/0 conn(0x7f3eec14d760 0x7f3eec0c1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:33322/0 (socket says 172.21.15.53:33322) 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef099b700 1 --2- 172.21.15.53:0/3674237219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3eeb7fe700 1 -- 172.21.15.53:0/3674237219 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950530495 0 0) 0x7f3eec0c1590 con 0x7f3eec14d760 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3eeb7fe700 1 -- 172.21.15.53:0/3674237219 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3edc003570 con 0x7f3eec14d760 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3eeb7fe700 1 -- 172.21.15.53:0/3674237219 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375797595 0 0) 0x7f3ed8001110 con 0x7f3eec0c47c0 2023-09-28T00:23:28.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef099b700 1 -- 172.21.15.53:0/3674237219 >> v1:172.21.15.118:6789/0 conn(0x7f3eec14d760 legacy=0x7f3eec0c1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef099b700 1 -- 172.21.15.53:0/3674237219 >> v1:172.21.15.53:6789/0 conn(0x7f3eec0c47c0 legacy=0x7f3eec1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.377+0000 7f3ef099b700 1 -- 172.21.15.53:0/3674237219 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0c3b60 con 0x7f3eec1570e0 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.378+0000 7f3ef099b700 1 --2- 172.21.15.53:0/3674237219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec06c680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009910 tx=0x7f3ee00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=540a9c7ab925895c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.378+0000 7f3eeb7fe700 1 -- 172.21.15.53:0/3674237219 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000b710 con 0x7f3eec1570e0 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.378+0000 7f3eeb7fe700 1 -- 172.21.15.53:0/3674237219 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee000b870 con 0x7f3eec1570e0 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.378+0000 7f3eeb7fe700 1 -- 172.21.15.53:0/3674237219 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000bc30 con 0x7f3eec1570e0 2023-09-28T00:23:28.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.378+0000 7f3ef199d700 1 -- 172.21.15.53:0/3674237219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 msgr2=0x7f3eec06c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.378+0000 7f3ef199d700 1 --2- 172.21.15.53:0/3674237219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec06c680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009910 tx=0x7f3ee00091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.379+0000 7f3ef199d700 1 -- 172.21.15.53:0/3674237219 shutdown_connections 2023-09-28T00:23:28.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.379+0000 7f3ef199d700 1 --2- 172.21.15.53:0/3674237219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec06c680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.379+0000 7f3ef199d700 1 -- 172.21.15.53:0/3674237219 >> 172.21.15.53:0/3674237219 conn(0x7f3eec067630 msgr2=0x7f3eec067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:28.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.379+0000 7f3ef199d700 1 -- 172.21.15.53:0/3674237219 shutdown_connections 2023-09-28T00:23:28.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.379+0000 7f3ef199d700 1 -- 172.21.15.53:0/3674237219 wait complete. 2023-09-28T00:23:28.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.380+0000 7f3ef199d700 1 Processor -- start 2023-09-28T00:23:28.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.380+0000 7f3ef199d700 1 -- start start 2023-09-28T00:23:28.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.381+0000 7f3ef199d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3eec0c47c0 0x7f3eec166290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.381+0000 7f3ef199d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec14d760 0x7f3eec14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.381+0000 7f3ef199d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.381+0000 7f3ef199d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec150500 con 0x7f3eec14d760 2023-09-28T00:23:28.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.381+0000 7f3ef199d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec1667d0 con 0x7f3eec0c47c0 2023-09-28T00:23:28.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.381+0000 7f3ef199d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec169790 con 0x7f3eec1570e0 2023-09-28T00:23:28.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec14d760 0x7f3eec14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3ef099b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3eec0c47c0 0x7f3eec166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec14d760 0x7f3eec14bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40890/0 (socket says 172.21.15.53:40890) 2023-09-28T00:23:28.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 -- 172.21.15.53:0/3042258261 learned_addr learned my addr 172.21.15.53:0/3042258261 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:28.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3ef119c700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 -- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 msgr2=0x7f3eec14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3eec1570e0 0x7f3eec14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 -- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3eec0c47c0 msgr2=0x7f3eec166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3eec0c47c0 0x7f3eec166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 -- 172.21.15.53:0/3042258261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0009420 con 0x7f3eec14d760 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3ef099b700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3eec0c47c0 0x7f3eec166290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.382+0000 7f3eebfff700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec14d760 0x7f3eec14bea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c810 tx=0x7f3ed8007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.383+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8005b30 con 0x7f3eec14d760 2023-09-28T00:23:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.383+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8005c90 con 0x7f3eec14d760 2023-09-28T00:23:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.383+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8007300 con 0x7f3eec14d760 2023-09-28T00:23:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.383+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec15fef0 con 0x7f3eec14d760 2023-09-28T00:23:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.383+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec14e510 con 0x7f3eec14d760 2023-09-28T00:23:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.383+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3eec14e8b0 con 0x7f3eec14d760 2023-09-28T00:23:28.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.385+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3ed801b3b0 con 0x7f3eec14d760 2023-09-28T00:23:28.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.385+0000 7f3ee8ff9700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3ed0067330 0x7f3ed00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.386+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ed8083fa0 con 0x7f3eec14d760 2023-09-28T00:23:28.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.386+0000 7f3ee8ff9700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7f3ed006fbe0 0x7f3ed0071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.386+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 --> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ed00726a0 con 0x7f3ed006fbe0 2023-09-28T00:23:28.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.386+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed80864a0 con 0x7f3eec14d760 2023-09-28T00:23:28.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.386+0000 7f3ef099b700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3ed0067330 0x7f3ed00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.386+0000 7f3ef119c700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7f3ed006fbe0 0x7f3ed0071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.387+0000 7f3ef099b700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3ed0067330 0x7f3ed00697e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00093f0 tx=0x7f3ee0017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.387+0000 7f3ef119c700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7f3ed006fbe0 0x7f3ed0071ff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.387+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== osd.2 v2:172.21.15.53:6824/85121 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3ed00726a0 con 0x7f3ed006fbe0 2023-09-28T00:23:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.402+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 --> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3eec06cd30 con 0x7f3ed006fbe0 2023-09-28T00:23:28.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.402+0000 7f3ee8ff9700 1 -- 172.21.15.53:0/3042258261 <== osd.2 v2:172.21.15.53:6824/85121 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3eec06cd30 con 0x7f3ed006fbe0 2023-09-28T00:23:28.402 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:28.403 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:28.403 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7f3ed006fbe0 msgr2=0x7f3ed0071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:6824/85121,v1:172.21.15.53:6825/85121] conn(0x7f3ed006fbe0 0x7f3ed0071ff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3ed0067330 msgr2=0x7f3ed00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3ed0067330 0x7f3ed00697e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00093f0 tx=0x7f3ee0017000 comp rx=0 tx=0).stop 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec14d760 msgr2=0x7f3eec14bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 --2- 172.21.15.53:0/3042258261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec14d760 0x7f3eec14bea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c810 tx=0x7f3ed8007c50 comp rx=0 tx=0).stop 2023-09-28T00:23:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef119c700 1 -- 172.21.15.53:0/3042258261 reap_dead start 2023-09-28T00:23:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 shutdown_connections 2023-09-28T00:23:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 >> 172.21.15.53:0/3042258261 conn(0x7f3eec067630 msgr2=0x7f3eec0c2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 shutdown_connections 2023-09-28T00:23:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.403+0000 7f3ef199d700 1 -- 172.21.15.53:0/3042258261 wait complete. 2023-09-28T00:23:28.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-28T00:23:28.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.608+0000 7f3782f9d700 1 Processor -- start 2023-09-28T00:23:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.608+0000 7f3782f9d700 1 -- start start 2023-09-28T00:23:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3782f9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f377c0c0e10 0x7f377c159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3782f9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f377c0c11e0 0x7f377c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3782f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3782f9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c156040 con 0x7f377c0c0e10 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3782f9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0c6cf0 con 0x7f377c0c11e0 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3782f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c6730 con 0x7f377c0c16e0 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3781f9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f377c0c0e10 0x7f377c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3781f9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f377c0c0e10 0x7f377c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40894/0 (socket says 172.21.15.53:40894) 2023-09-28T00:23:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f3781f9b700 1 -- 172.21.15.53:0/2841611328 learned_addr learned my addr 172.21.15.53:0/2841611328 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f378179a700 1 --2- 172.21.15.53:0/2841611328 >> v2:172.21.15.118:3300/0 conn(0x7f377c0c11e0 0x7f377c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.610+0000 7f378279c700 1 --2- 172.21.15.53:0/2841611328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3781f9b700 1 -- 172.21.15.53:0/2841611328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 msgr2=0x7f377c068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3781f9b700 1 --2- 172.21.15.53:0/2841611328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c068bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3781f9b700 1 -- 172.21.15.53:0/2841611328 >> v2:172.21.15.118:3300/0 conn(0x7f377c0c11e0 msgr2=0x7f377c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3781f9b700 1 --2- 172.21.15.53:0/2841611328 >> v2:172.21.15.118:3300/0 conn(0x7f377c0c11e0 0x7f377c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3781f9b700 1 -- 172.21.15.53:0/2841611328 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0c6a10 con 0x7f377c0c0e10 2023-09-28T00:23:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3781f9b700 1 --2- 172.21.15.53:0/2841611328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c159840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b1eb0 tx=0x7f3778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b960271a49d0a880 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3780f99700 1 -- 172.21.15.53:0/2841611328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b640 con 0x7f377c0c0e10 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3780f99700 1 -- 172.21.15.53:0/2841611328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800b7a0 con 0x7f377c0c0e10 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.611+0000 7f3780f99700 1 -- 172.21.15.53:0/2841611328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800bb60 con 0x7f377c0c0e10 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 -- 172.21.15.53:0/2841611328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 msgr2=0x7f377c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 --2- 172.21.15.53:0/2841611328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c159840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b1eb0 tx=0x7f3778009250 comp rx=0 tx=0).stop 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 -- 172.21.15.53:0/2841611328 shutdown_connections 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 --2- 172.21.15.53:0/2841611328 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c068bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 --2- 172.21.15.53:0/2841611328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c159840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 --2- 172.21.15.53:0/2841611328 >> v2:172.21.15.118:3300/0 conn(0x7f377c0c11e0 0x7f377c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 -- 172.21.15.53:0/2841611328 >> 172.21.15.53:0/2841611328 conn(0x7f377c06f830 msgr2=0x7f377c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 -- 172.21.15.53:0/2841611328 shutdown_connections 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.612+0000 7f3782f9d700 1 -- 172.21.15.53:0/2841611328 wait complete. 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.613+0000 7f3782f9d700 1 Processor -- start 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.613+0000 7f3782f9d700 1 -- start start 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3782f9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3782f9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f377c0c11e0 0x7f377c166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3782f9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3782f9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0ae700 con 0x7f377c0c0e10 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3782f9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c166b80 con 0x7f377c0c11e0 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3782f9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0abca0 con 0x7f377c0c16e0 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3781f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3781f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40896/0 (socket says 172.21.15.53:40896) 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.614+0000 7f3781f9b700 1 -- 172.21.15.53:0/4250369180 learned_addr learned my addr 172.21.15.53:0/4250369180 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f378279c700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f378179a700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f377c0c11e0 0x7f377c166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3781f9b700 1 -- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 msgr2=0x7f377c139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3781f9b700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3781f9b700 1 -- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f377c0c11e0 msgr2=0x7f377c166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3781f9b700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f377c0c11e0 0x7f377c166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3781f9b700 1 -- 172.21.15.53:0/4250369180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780094f0 con 0x7f377c0c0e10 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f378279c700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3781f9b700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c156a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f377c06a720 tx=0x7f3778017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.615+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b910 con 0x7f377c0c0e10 2023-09-28T00:23:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.616+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800ba70 con 0x7f377c0c0e10 2023-09-28T00:23:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.616+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011630 con 0x7f377c0c0e10 2023-09-28T00:23:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.616+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c0abf80 con 0x7f377c0c0e10 2023-09-28T00:23:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.616+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c165e40 con 0x7f377c0c0e10 2023-09-28T00:23:28.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.617+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c165ca0 con 0x7f377c0c0e10 2023-09-28T00:23:28.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.617+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f37780119a0 con 0x7f377c0c0e10 2023-09-28T00:23:28.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.619+0000 7f3771ffb700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3760067330 0x7f37600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:28.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.619+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f37780863c0 con 0x7f377c0c0e10 2023-09-28T00:23:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.619+0000 7f378179a700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3760067330 0x7f37600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.620+0000 7f378179a700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3760067330 0x7f37600697e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f377c0c2470 tx=0x7f376c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:28.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.624+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f377c165ca0 con 0x7f377c0c0e10 2023-09-28T00:23:28.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.827+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f377c165ca0 con 0x7f3760067330 2023-09-28T00:23:28.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.828+0000 7f3771ffb700 1 -- 172.21.15.53:0/4250369180 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f377c165ca0 con 0x7f3760067330 2023-09-28T00:23:28.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3760067330 msgr2=0x7f37600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3760067330 0x7f37600697e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f377c0c2470 tx=0x7f376c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 msgr2=0x7f377c156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:28.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c156a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f377c06a720 tx=0x7f3778017000 comp rx=0 tx=0).stop 2023-09-28T00:23:28.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 shutdown_connections 2023-09-28T00:23:28.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f3760067330 0x7f37600697e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f377c0c16e0 0x7f377c139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0c0e10 0x7f377c156a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 --2- 172.21.15.53:0/4250369180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f377c0c11e0 0x7f377c166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:28.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 >> 172.21.15.53:0/4250369180 conn(0x7f377c06f830 msgr2=0x7f377c13aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:28.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 shutdown_connections 2023-09-28T00:23:28.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:28.830+0000 7f3782f9d700 1 -- 172.21.15.53:0/4250369180 wait complete. 2023-09-28T00:23:28.832 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2023-09-28T00:23:28.847 INFO:tasks.ceph:Scrubbing osd.3 2023-09-28T00:23:28.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:29.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.037+0000 7f7952b9d700 1 Processor -- start 2023-09-28T00:23:29.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.037+0000 7f7952b9d700 1 -- start start 2023-09-28T00:23:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.038+0000 7f7952b9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f794c14c7c0 0x7f794c0c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7952b9d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c06f9e0 con 0x7f794c06d4c0 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7952b9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c153040 con 0x7f794c0c0b70 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7952b9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0bfc60 con 0x7f794c14c7c0 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f795139a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f794c06d4c0 0x7f794c06df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59686/0 (socket says 172.21.15.53:59686) 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f795139a700 1 -- 172.21.15.53:0/1148599926 learned_addr learned my addr 172.21.15.53:0/1148599926 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7951b9b700 1 --2- 172.21.15.53:0/1148599926 >> v2:172.21.15.118:3300/0 conn(0x7f794c14c7c0 0x7f794c0c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948103101 0 0) 0x7f794c153040 con 0x7f794c0c0b70 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7938003570 con 0x7f794c0c0b70 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034611863 0 0) 0x7f794c06f9e0 con 0x7f794c06d4c0 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f794c153040 con 0x7f794c06d4c0 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7951b9b700 1 -- 172.21.15.53:0/1148599926 >> v1:172.21.15.118:6789/0 conn(0x7f794c0c0b70 legacy=0x7f794c06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7951b9b700 1 -- 172.21.15.53:0/1148599926 >> v1:172.21.15.53:6789/0 conn(0x7f794c06d4c0 legacy=0x7f794c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.039+0000 7f7951b9b700 1 -- 172.21.15.53:0/1148599926 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0c0fb0 con 0x7f794c14c7c0 2023-09-28T00:23:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.040+0000 7f7951b9b700 1 --2- 172.21.15.53:0/1148599926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c14c7c0 0x7f794c0c0630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79480098e0 tx=0x7f79480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d608a14a490b2b12 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.040+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948011630 con 0x7f794c14c7c0 2023-09-28T00:23:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.040+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948011790 con 0x7f794c14c7c0 2023-09-28T00:23:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.040+0000 7f7950b99700 1 -- 172.21.15.53:0/1148599926 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948011b30 con 0x7f794c14c7c0 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.040+0000 7f7952b9d700 1 -- 172.21.15.53:0/1148599926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c14c7c0 msgr2=0x7f794c0c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.040+0000 7f7952b9d700 1 --2- 172.21.15.53:0/1148599926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c14c7c0 0x7f794c0c0630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79480098e0 tx=0x7f79480091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.041+0000 7f7952b9d700 1 -- 172.21.15.53:0/1148599926 shutdown_connections 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.041+0000 7f7952b9d700 1 --2- 172.21.15.53:0/1148599926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c14c7c0 0x7f794c0c0630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.041+0000 7f7952b9d700 1 -- 172.21.15.53:0/1148599926 >> 172.21.15.53:0/1148599926 conn(0x7f794c068100 msgr2=0x7f794c0c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.041+0000 7f7952b9d700 1 -- 172.21.15.53:0/1148599926 shutdown_connections 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.041+0000 7f7952b9d700 1 -- 172.21.15.53:0/1148599926 wait complete. 2023-09-28T00:23:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.042+0000 7f7952b9d700 1 Processor -- start 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.042+0000 7f7952b9d700 1 -- start start 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7952b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c06d4c0 0x7f794c165ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7952b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f794c0c0b70 0x7f794c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7952b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f794c14c7c0 0x7f794c159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7952b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c156310 con 0x7f794c14c7c0 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7952b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c165640 con 0x7f794c06d4c0 2023-09-28T00:23:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7952b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c156ca0 con 0x7f794c0c0b70 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f795239c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f794c14c7c0 0x7f794c159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f795239c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f794c14c7c0 0x7f794c159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40902/0 (socket says 172.21.15.53:40902) 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f795239c700 1 -- 172.21.15.53:0/1914707936 learned_addr learned my addr 172.21.15.53:0/1914707936 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f7951b9b700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c06d4c0 0x7f794c165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.043+0000 7f795139a700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f794c0c0b70 0x7f794c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795239c700 1 -- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f794c0c0b70 msgr2=0x7f794c158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795239c700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f794c0c0b70 0x7f794c158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795239c700 1 -- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c06d4c0 msgr2=0x7f794c165ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795239c700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f794c06d4c0 0x7f794c165ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795239c700 1 -- 172.21.15.53:0/1914707936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948009420 con 0x7f794c14c7c0 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795139a700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f794c0c0b70 0x7f794c158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f795239c700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f794c14c7c0 0x7f794c159260 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f794400c940 tx=0x7f79440027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400a680 con 0x7f794c14c7c0 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400a7e0 con 0x7f794c14c7c0 2023-09-28T00:23:29.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0c5830 con 0x7f794c14c7c0 2023-09-28T00:23:29.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400aba0 con 0x7f794c14c7c0 2023-09-28T00:23:29.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.044+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c156560 con 0x7f794c14c7c0 2023-09-28T00:23:29.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.045+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f794c071830 con 0x7f794c14c7c0 2023-09-28T00:23:29.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.046+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7944012420 con 0x7f794c14c7c0 2023-09-28T00:23:29.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.047+0000 7f7941ffb700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7930067330 0x7f79300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.047+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7944084a10 con 0x7f794c14c7c0 2023-09-28T00:23:29.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.047+0000 7f7951b9b700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7930067330 0x7f79300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.047+0000 7f7941ffb700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f793006fbe0 0x7f7930071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.047+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 --> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79300726a0 con 0x7f793006fbe0 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.047+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7944089220 con 0x7f794c14c7c0 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.048+0000 7f795139a700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f793006fbe0 0x7f7930071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.048+0000 7f7951b9b700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7930067330 0x7f79300697e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79480093f0 tx=0x7f7948017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.048+0000 7f795139a700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f793006fbe0 0x7f7930071ff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.049+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== osd.3 v2:172.21.15.53:6816/85094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f79300726a0 con 0x7f793006fbe0 2023-09-28T00:23:29.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.063+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 --> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f794c0c8290 con 0x7f793006fbe0 2023-09-28T00:23:29.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7941ffb700 1 -- 172.21.15.53:0/1914707936 <== osd.3 v2:172.21.15.53:6816/85094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f794c0c8290 con 0x7f793006fbe0 2023-09-28T00:23:29.064 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:29.064 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f793006fbe0 msgr2=0x7f7930071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:6816/85094,v1:172.21.15.53:6817/85094] conn(0x7f793006fbe0 0x7f7930071ff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7930067330 msgr2=0x7f79300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7930067330 0x7f79300697e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79480093f0 tx=0x7f7948017000 comp rx=0 tx=0).stop 2023-09-28T00:23:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f794c14c7c0 msgr2=0x7f794c159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 --2- 172.21.15.53:0/1914707936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f794c14c7c0 0x7f794c159260 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f794400c940 tx=0x7f79440027a0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f795239c700 1 -- 172.21.15.53:0/1914707936 reap_dead start 2023-09-28T00:23:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 shutdown_connections 2023-09-28T00:23:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 >> 172.21.15.53:0/1914707936 conn(0x7f794c068100 msgr2=0x7f794c149500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 shutdown_connections 2023-09-28T00:23:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.064+0000 7f7952b9d700 1 -- 172.21.15.53:0/1914707936 wait complete. 2023-09-28T00:23:29.080 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-28T00:23:29.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:23:29.134 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:23:29.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.270+0000 7f451639d700 1 Processor -- start 2023-09-28T00:23:29.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.270+0000 7f451639d700 1 -- start start 2023-09-28T00:23:29.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f451639d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f451006f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f451639d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f451006c550 0x7f451006f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f451639d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451006cab0 con 0x7f4510155750 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f451639d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100c5070 con 0x7f451006c550 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f451639d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4510159970 con 0x7f451014f7c0 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f4514b9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f451006c550 0x7f451006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f4515b9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4510155750 0x7f4510067630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59698/0 (socket says 172.21.15.53:59698) 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f4515b9c700 1 -- 172.21.15.53:0/1251893182 learned_addr learned my addr 172.21.15.53:0/1251893182 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f451539b700 1 --2- 172.21.15.53:0/1251893182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f451006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f4514b9a700 1 -- 172.21.15.53:0/1251893182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 msgr2=0x7f451006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:29.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f4514b9a700 1 --2- 172.21.15.53:0/1251893182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f451006f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.272+0000 7f4514b9a700 1 -- 172.21.15.53:0/1251893182 >> v1:172.21.15.53:6789/0 conn(0x7f4510155750 legacy=0x7f4510067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f4514b9a700 1 -- 172.21.15.53:0/1251893182 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510158cf0 con 0x7f451006c550 2023-09-28T00:23:29.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f4507fff700 1 -- 172.21.15.53:0/1251893182 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803012529 0 0) 0x7f451006cab0 con 0x7f4510155750 2023-09-28T00:23:29.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f4514b9a700 1 --2- 172.21.15.53:0/1251893182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f451006c550 0x7f451006f660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45000098e0 tx=0x7f45000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642bad4a4e4ea462 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f4507fff700 1 -- 172.21.15.53:0/1251893182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000b640 con 0x7f451006c550 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f4507fff700 1 -- 172.21.15.53:0/1251893182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000b7a0 con 0x7f451006c550 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f4507fff700 1 -- 172.21.15.53:0/1251893182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000bb40 con 0x7f451006c550 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f451639d700 1 -- 172.21.15.53:0/1251893182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f451006c550 msgr2=0x7f451006f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.273+0000 7f451639d700 1 --2- 172.21.15.53:0/1251893182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f451006c550 0x7f451006f660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45000098e0 tx=0x7f45000091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.274+0000 7f451639d700 1 -- 172.21.15.53:0/1251893182 shutdown_connections 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.274+0000 7f451639d700 1 --2- 172.21.15.53:0/1251893182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f451006f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.274+0000 7f451639d700 1 --2- 172.21.15.53:0/1251893182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f451006c550 0x7f451006f660 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.274+0000 7f451639d700 1 -- 172.21.15.53:0/1251893182 >> 172.21.15.53:0/1251893182 conn(0x7f4510068740 msgr2=0x7f4510068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.274+0000 7f451639d700 1 -- 172.21.15.53:0/1251893182 shutdown_connections 2023-09-28T00:23:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.274+0000 7f451639d700 1 -- 172.21.15.53:0/1251893182 wait complete. 2023-09-28T00:23:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.275+0000 7f451639d700 1 Processor -- start 2023-09-28T00:23:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.275+0000 7f451639d700 1 -- start start 2023-09-28T00:23:29.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f451639d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f451006c550 0x7f4510168470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f451639d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f4510068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f451639d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 0x7f4510144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f451639d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100c81f0 con 0x7f4510155750 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f451639d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45101584a0 con 0x7f451006c550 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f451639d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4510156900 con 0x7f451014f7c0 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.276+0000 7f4515b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 0x7f4510144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 0x7f4510144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40924/0 (socket says 172.21.15.53:40924) 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 -- 172.21.15.53:0/1347899743 learned_addr learned my addr 172.21.15.53:0/1347899743 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f451539b700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f451006c550 0x7f4510168470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4514b9a700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f4510068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 -- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 msgr2=0x7f4510068cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f4510068cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 -- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f451006c550 msgr2=0x7f4510168470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f451006c550 0x7f4510168470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 -- 172.21.15.53:0/1347899743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500009420 con 0x7f4510155750 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f4515b9c700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 0x7f4510144670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f450800cc20 tx=0x7f45080019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800a870 con 0x7f4510155750 2023-09-28T00:23:29.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800a9d0 con 0x7f4510155750 2023-09-28T00:23:29.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4510158200 con 0x7f4510155750 2023-09-28T00:23:29.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.277+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800ad90 con 0x7f4510155750 2023-09-28T00:23:29.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.278+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45100c8bc0 con 0x7f4510155750 2023-09-28T00:23:29.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.278+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100c8360 con 0x7f4510155750 2023-09-28T00:23:29.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.279+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4508007300 con 0x7f4510155750 2023-09-28T00:23:29.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.280+0000 7f45057fa700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f44f4067360 0x7f44f4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.280+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4508084f60 con 0x7f4510155750 2023-09-28T00:23:29.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.281+0000 7f451539b700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f44f4067360 0x7f44f4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.281+0000 7f451539b700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f44f4067360 0x7f44f4069810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f450c009db0 tx=0x7f450c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.284+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4508051e40 con 0x7f4510155750 2023-09-28T00:23:29.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.487+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f451004c3c0 con 0x7f44f4067360 2023-09-28T00:23:29.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.488+0000 7f45057fa700 1 -- 172.21.15.53:0/1347899743 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f451004c3c0 con 0x7f44f4067360 2023-09-28T00:23:29.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f44f4067360 msgr2=0x7f44f4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f44f4067360 0x7f44f4069810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f450c009db0 tx=0x7f450c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 msgr2=0x7f4510144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 0x7f4510144670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f450800cc20 tx=0x7f45080019b0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 shutdown_connections 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f44f4067360 0x7f44f4069810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4510155750 0x7f4510144670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f451006c550 0x7f4510168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 --2- 172.21.15.53:0/1347899743 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f451014f7c0 0x7f4510068cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 >> 172.21.15.53:0/1347899743 conn(0x7f4510068740 msgr2=0x7f45100c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 shutdown_connections 2023-09-28T00:23:29.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.490+0000 7f451639d700 1 -- 172.21.15.53:0/1347899743 wait complete. 2023-09-28T00:23:29.493 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2023-09-28T00:23:29.508 INFO:tasks.ceph:Scrubbing osd.4 2023-09-28T00:23:29.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:29.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.698+0000 7f4cf09fe700 1 Processor -- start 2023-09-28T00:23:29.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.698+0000 7f4cf09fe700 1 -- start start 2023-09-28T00:23:29.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.699+0000 7f4cf09fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec06d4c0 0x7f4cec06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.699+0000 7f4cf09fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4cec0c0d40 0x7f4cec06e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.699+0000 7f4cf09fe700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec06f9e0 con 0x7f4cec14c7c0 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.699+0000 7f4cf09fe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0bfc60 con 0x7f4cec0c0d40 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.699+0000 7f4cf09fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec153040 con 0x7f4cec06d4c0 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4cead9d700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4cec14c7c0 0x7f4cec0c0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59700/0 (socket says 172.21.15.53:59700) 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4cead9d700 1 -- 172.21.15.53:0/286743984 learned_addr learned my addr 172.21.15.53:0/286743984 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:29.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ceb59e700 1 --2- 172.21.15.53:0/286743984 >> v2:172.21.15.118:3300/0 conn(0x7f4cec0c0d40 0x7f4cec06e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4cea59c700 1 --2- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec06d4c0 0x7f4cec06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ce9d9b700 1 -- 172.21.15.53:0/286743984 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964627375 0 0) 0x7f4cec06f9e0 con 0x7f4cec14c7c0 2023-09-28T00:23:29.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ce9d9b700 1 -- 172.21.15.53:0/286743984 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd4003570 con 0x7f4cec14c7c0 2023-09-28T00:23:29.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ceb59e700 1 -- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec06d4c0 msgr2=0x7f4cec06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:29.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ceb59e700 1 --2- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec06d4c0 0x7f4cec06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ceb59e700 1 -- 172.21.15.53:0/286743984 >> v1:172.21.15.53:6789/0 conn(0x7f4cec14c7c0 legacy=0x7f4cec0c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.700+0000 7f4ceb59e700 1 -- 172.21.15.53:0/286743984 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec1532c0 con 0x7f4cec0c0d40 2023-09-28T00:23:29.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4ceb59e700 1 --2- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0c0d40 0x7f4cec06e4b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009e60 tx=0x7f4ce4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b35784f3a05d30b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4ce9d9b700 1 -- 172.21.15.53:0/286743984 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400e070 con 0x7f4cec0c0d40 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4ce9d9b700 1 -- 172.21.15.53:0/286743984 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce400bab0 con 0x7f4cec0c0d40 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4ce9d9b700 1 -- 172.21.15.53:0/286743984 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400be70 con 0x7f4cec0c0d40 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4cf09fe700 1 -- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0c0d40 msgr2=0x7f4cec06e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4cf09fe700 1 --2- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0c0d40 0x7f4cec06e4b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009e60 tx=0x7f4ce4009780 comp rx=0 tx=0).stop 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4cf09fe700 1 -- 172.21.15.53:0/286743984 shutdown_connections 2023-09-28T00:23:29.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4cf09fe700 1 --2- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec0c0d40 0x7f4cec06e4b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4cf09fe700 1 --2- 172.21.15.53:0/286743984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec06d4c0 0x7f4cec06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.701+0000 7f4cf09fe700 1 -- 172.21.15.53:0/286743984 >> 172.21.15.53:0/286743984 conn(0x7f4cec068100 msgr2=0x7f4cec0c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.702+0000 7f4cf09fe700 1 -- 172.21.15.53:0/286743984 shutdown_connections 2023-09-28T00:23:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.702+0000 7f4cf09fe700 1 -- 172.21.15.53:0/286743984 wait complete. 2023-09-28T00:23:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.703+0000 7f4cf09fe700 1 Processor -- start 2023-09-28T00:23:29.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.703+0000 7f4cf09fe700 1 -- start start 2023-09-28T00:23:29.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cf09fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec06d4c0 0x7f4cec166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cf09fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0c0d40 0x7f4cec157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cf09fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec14c7c0 0x7f4cec157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cf09fe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0b8830 con 0x7f4cec0c0d40 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cf09fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0c2260 con 0x7f4cec06d4c0 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cf09fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec156d40 con 0x7f4cec14c7c0 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cea59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0c0d40 0x7f4cec157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cea59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0c0d40 0x7f4cec157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40928/0 (socket says 172.21.15.53:40928) 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cea59c700 1 -- 172.21.15.53:0/1151916817 learned_addr learned my addr 172.21.15.53:0/1151916817 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4cead9d700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec06d4c0 0x7f4cec166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.704+0000 7f4ceb59e700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec14c7c0 0x7f4cec157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cea59c700 1 -- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec14c7c0 msgr2=0x7f4cec157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cea59c700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cec14c7c0 0x7f4cec157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cea59c700 1 -- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec06d4c0 msgr2=0x7f4cec166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cea59c700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cec06d4c0 0x7f4cec166380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cea59c700 1 -- 172.21.15.53:0/1151916817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4009a20 con 0x7f4cec0c0d40 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cea59c700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0c0d40 0x7f4cec157500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000ecb0 tx=0x7f4ce00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000c850 con 0x7f4cec0c0d40 2023-09-28T00:23:29.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000c9b0 con 0x7f4cec0c0d40 2023-09-28T00:23:29.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000cd50 con 0x7f4cec0c0d40 2023-09-28T00:23:29.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec0c24b0 con 0x7f4cec0c0d40 2023-09-28T00:23:29.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.705+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec156fe0 con 0x7f4cec0c0d40 2023-09-28T00:23:29.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.706+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4cec071830 con 0x7f4cec0c0d40 2023-09-28T00:23:29.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.707+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4ce0013680 con 0x7f4cec0c0d40 2023-09-28T00:23:29.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.708+0000 7f4cd2ffd700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4cd8067330 0x7f4cd80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.709+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ce0084e80 con 0x7f4cec0c0d40 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.709+0000 7f4cd2ffd700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f4cd806fbe0 0x7f4cd8071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.709+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 --> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4cd80726a0 con 0x7f4cd806fbe0 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.709+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ce0087380 con 0x7f4cec0c0d40 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.709+0000 7f4cead9d700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4cd8067330 0x7f4cd80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.709+0000 7f4ceb59e700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f4cd806fbe0 0x7f4cd8071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.710+0000 7f4cead9d700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4cd8067330 0x7f4cd80697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc007fd0 tx=0x7f4cdc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.710+0000 7f4ceb59e700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f4cd806fbe0 0x7f4cd8071ff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.710+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== osd.4 v2:172.21.15.118:6800/120721 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4cd80726a0 con 0x7f4cd806fbe0 2023-09-28T00:23:29.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.725+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 --> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4cec0bec70 con 0x7f4cd806fbe0 2023-09-28T00:23:29.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.726+0000 7f4cd2ffd700 1 -- 172.21.15.53:0/1151916817 <== osd.4 v2:172.21.15.118:6800/120721 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4cec0bec70 con 0x7f4cd806fbe0 2023-09-28T00:23:29.727 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:29.727 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:29.727 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:29.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f4cd806fbe0 msgr2=0x7f4cd8071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6800/120721,v1:172.21.15.118:6801/120721] conn(0x7f4cd806fbe0 0x7f4cd8071ff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4cd8067330 msgr2=0x7f4cd80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f4cd8067330 0x7f4cd80697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc007fd0 tx=0x7f4cdc009040 comp rx=0 tx=0).stop 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0c0d40 msgr2=0x7f4cec157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 --2- 172.21.15.53:0/1151916817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0c0d40 0x7f4cec157500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000ecb0 tx=0x7f4ce00091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4ceb59e700 1 -- 172.21.15.53:0/1151916817 reap_dead start 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 shutdown_connections 2023-09-28T00:23:29.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 >> 172.21.15.53:0/1151916817 conn(0x7f4cec068100 msgr2=0x7f4cec06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 shutdown_connections 2023-09-28T00:23:29.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.727+0000 7f4cf09fe700 1 -- 172.21.15.53:0/1151916817 wait complete. 2023-09-28T00:23:29.744 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-28T00:23:29.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.932+0000 7f066df9d700 1 Processor -- start 2023-09-28T00:23:29.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.932+0000 7f066df9d700 1 -- start start 2023-09-28T00:23:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066df9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06680c0e10 0x7f0668159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066df9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f066813ed20 0x7f06680cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066df9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0668156040 con 0x7f06680c11e0 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066df9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680c6cf0 con 0x7f06680c0e10 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066df9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680c6730 con 0x7f066813ed20 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066cf9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06680c0e10 0x7f0668159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066cf9b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06680c0e10 0x7f0668159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40930/0 (socket says 172.21.15.53:40930) 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066cf9b700 1 -- 172.21.15.53:0/999716668 learned_addr learned my addr 172.21.15.53:0/999716668 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.933+0000 7f066d79c700 1 --2- 172.21.15.53:0/999716668 >> v2:172.21.15.118:3300/0 conn(0x7f066813ed20 0x7f06680cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f06677fe700 1 -- 172.21.15.53:0/999716668 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548169429 0 0) 0x7f0668156040 con 0x7f06680c11e0 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f06677fe700 1 -- 172.21.15.53:0/999716668 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0658003570 con 0x7f06680c11e0 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f066cf9b700 1 -- 172.21.15.53:0/999716668 >> v2:172.21.15.118:3300/0 conn(0x7f066813ed20 msgr2=0x7f06680cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f066cf9b700 1 --2- 172.21.15.53:0/999716668 >> v2:172.21.15.118:3300/0 conn(0x7f066813ed20 0x7f06680cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f066cf9b700 1 -- 172.21.15.53:0/999716668 >> v1:172.21.15.118:6789/0 conn(0x7f06680c11e0 legacy=0x7f066813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f066cf9b700 1 -- 172.21.15.53:0/999716668 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680c6a10 con 0x7f06680c0e10 2023-09-28T00:23:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f066d79c700 1 --2- 172.21.15.53:0/999716668 >> v2:172.21.15.118:3300/0 conn(0x7f066813ed20 0x7f06680cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f066cf9b700 1 --2- 172.21.15.53:0/999716668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06680c0e10 0x7f0668159840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f06681501f0 tx=0x7f065c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e862fcb8d3f33756 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.934+0000 7f06677fe700 1 -- 172.21.15.53:0/999716668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c00b640 con 0x7f06680c0e10 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f06677fe700 1 -- 172.21.15.53:0/999716668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c00b7a0 con 0x7f06680c0e10 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f06677fe700 1 -- 172.21.15.53:0/999716668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c00bb60 con 0x7f06680c0e10 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 -- 172.21.15.53:0/999716668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06680c0e10 msgr2=0x7f0668159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 --2- 172.21.15.53:0/999716668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06680c0e10 0x7f0668159840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f06681501f0 tx=0x7f065c009250 comp rx=0 tx=0).stop 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 -- 172.21.15.53:0/999716668 shutdown_connections 2023-09-28T00:23:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 --2- 172.21.15.53:0/999716668 >> v2:172.21.15.118:3300/0 conn(0x7f066813ed20 0x7f06680cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 --2- 172.21.15.53:0/999716668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06680c0e10 0x7f0668159840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 -- 172.21.15.53:0/999716668 >> 172.21.15.53:0/999716668 conn(0x7f066806f830 msgr2=0x7f06680cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 -- 172.21.15.53:0/999716668 shutdown_connections 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.935+0000 7f066df9d700 1 -- 172.21.15.53:0/999716668 wait complete. 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.937+0000 7f066df9d700 1 Processor -- start 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.937+0000 7f066df9d700 1 -- start start 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066df9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680c0e10 0x7f06681664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066df9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680c11e0 0x7f066813aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066df9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 0x7f0668169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066df9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680b19e0 con 0x7f066813ed20 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066df9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668166a10 con 0x7f06680c0e10 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066df9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668166040 con 0x7f06680c11e0 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 0x7f0668169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 0x7f0668169050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40932/0 (socket says 172.21.15.53:40932) 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 -- 172.21.15.53:0/1109549881 learned_addr learned my addr 172.21.15.53:0/1109549881 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f0667fff700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680c11e0 0x7f066813aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066cf9b700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680c0e10 0x7f06681664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 -- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680c11e0 msgr2=0x7f066813aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680c11e0 0x7f066813aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 -- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680c0e10 msgr2=0x7f06681664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680c0e10 0x7f06681664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.938+0000 7f066d79c700 1 -- 172.21.15.53:0/1109549881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660009a20 con 0x7f066813ed20 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.939+0000 7f066d79c700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 0x7f0668169050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0660009ec0 tx=0x7f066000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.939+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000cb70 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.939+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000f040 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.939+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c0094f0 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.939+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660014480 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.939+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0668156e20 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.940+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066804c3c0 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.941+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0660003020 con 0x7f066813ed20 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.942+0000 7f0664ff9700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f064c067330 0x7f064c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.942+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06600854b0 con 0x7f066813ed20 2023-09-28T00:23:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.942+0000 7f066cf9b700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f064c067330 0x7f064c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.943+0000 7f066cf9b700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f064c067330 0x7f064c0697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06681501f0 tx=0x7f065c017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:29.946+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0660052310 con 0x7f066813ed20 2023-09-28T00:23:30.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.152+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f06681559f0 con 0x7f064c067330 2023-09-28T00:23:30.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.153+0000 7f0664ff9700 1 -- 172.21.15.53:0/1109549881 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06681559f0 con 0x7f064c067330 2023-09-28T00:23:30.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.155+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f064c067330 msgr2=0x7f064c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.155+0000 7f066df9d700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f064c067330 0x7f064c0697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06681501f0 tx=0x7f065c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:30.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.155+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 msgr2=0x7f0668169050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.155+0000 7f066df9d700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 0x7f0668169050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0660009ec0 tx=0x7f066000b040 comp rx=0 tx=0).stop 2023-09-28T00:23:30.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 shutdown_connections 2023-09-28T00:23:30.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f064c067330 0x7f064c0697e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066813ed20 0x7f0668169050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680c0e10 0x7f06681664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 --2- 172.21.15.53:0/1109549881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680c11e0 0x7f066813aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 >> 172.21.15.53:0/1109549881 conn(0x7f066806f830 msgr2=0x7f06680cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 shutdown_connections 2023-09-28T00:23:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.156+0000 7f066df9d700 1 -- 172.21.15.53:0/1109549881 wait complete. 2023-09-28T00:23:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 4 to deep-scrub 2023-09-28T00:23:30.174 INFO:tasks.ceph:Scrubbing osd.5 2023-09-28T00:23:30.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:30.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.365+0000 7fc3ce79d700 1 Processor -- start 2023-09-28T00:23:30.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.366+0000 7fc3ce79d700 1 -- start start 2023-09-28T00:23:30.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3ce79d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc3c806a010 0x7fc3c80ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3ce79d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c806a3e0 0x7fc3c80abb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3ce79d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c8155710 con 0x7fc3c8069860 2023-09-28T00:23:30.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3ce79d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80ac0e0 con 0x7fc3c806a3e0 2023-09-28T00:23:30.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3ce79d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c8156390 con 0x7fc3c806a010 2023-09-28T00:23:30.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3ccf9a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c806a3e0 0x7fc3c80abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3cdf9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc3c8069860 0x7fc3c814f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59706/0 (socket says 172.21.15.53:59706) 2023-09-28T00:23:30.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3cdf9c700 1 -- 172.21.15.53:0/1918496245 learned_addr learned my addr 172.21.15.53:0/1918496245 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:30.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.367+0000 7fc3cd79b700 1 --2- 172.21.15.53:0/1918496245 >> v2:172.21.15.118:3300/0 conn(0x7fc3c806a010 0x7fc3c80ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3ccf9a700 1 -- 172.21.15.53:0/1918496245 >> v2:172.21.15.118:3300/0 conn(0x7fc3c806a010 msgr2=0x7fc3c80ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3ccf9a700 1 --2- 172.21.15.53:0/1918496245 >> v2:172.21.15.118:3300/0 conn(0x7fc3c806a010 0x7fc3c80ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3ccf9a700 1 -- 172.21.15.53:0/1918496245 >> v1:172.21.15.53:6789/0 conn(0x7fc3c8069860 legacy=0x7fc3c814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3ccf9a700 1 -- 172.21.15.53:0/1918496245 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c81559f0 con 0x7fc3c806a3e0 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3bffff700 1 -- 172.21.15.53:0/1918496245 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755486464 0 0) 0x7fc3c8155710 con 0x7fc3c8069860 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3ccf9a700 1 --2- 172.21.15.53:0/1918496245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c80abb00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80c2f60 tx=0x7fc3b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b87b2ed65d049f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3bffff700 1 -- 172.21.15.53:0/1918496245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8011630 con 0x7fc3c806a3e0 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3bffff700 1 -- 172.21.15.53:0/1918496245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8011790 con 0x7fc3c806a3e0 2023-09-28T00:23:30.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.368+0000 7fc3bffff700 1 -- 172.21.15.53:0/1918496245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8011b30 con 0x7fc3c806a3e0 2023-09-28T00:23:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 -- 172.21.15.53:0/1918496245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 msgr2=0x7fc3c80abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 --2- 172.21.15.53:0/1918496245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c80abb00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80c2f60 tx=0x7fc3b80091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 -- 172.21.15.53:0/1918496245 shutdown_connections 2023-09-28T00:23:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 --2- 172.21.15.53:0/1918496245 >> v2:172.21.15.118:3300/0 conn(0x7fc3c806a010 0x7fc3c80ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 --2- 172.21.15.53:0/1918496245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c80abb00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 -- 172.21.15.53:0/1918496245 >> 172.21.15.53:0/1918496245 conn(0x7fc3c80cbdc0 msgr2=0x7fc3c80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 -- 172.21.15.53:0/1918496245 shutdown_connections 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.369+0000 7fc3ce79d700 1 -- 172.21.15.53:0/1918496245 wait complete. 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.370+0000 7fc3ce79d700 1 Processor -- start 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.370+0000 7fc3ce79d700 1 -- start start 2023-09-28T00:23:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.371+0000 7fc3ce79d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c8069860 0x7fc3c8165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.371+0000 7fc3ce79d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c806a010 0x7fc3c8158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.371+0000 7fc3ce79d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c8168ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.371+0000 7fc3ce79d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80cb750 con 0x7fc3c806a3e0 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.371+0000 7fc3ce79d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8157770 con 0x7fc3c8069860 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.371+0000 7fc3ce79d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8156670 con 0x7fc3c806a010 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c8168ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c8168ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40946/0 (socket says 172.21.15.53:40946) 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 -- 172.21.15.53:0/2290013078 learned_addr learned my addr 172.21.15.53:0/2290013078 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3ccf9a700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c806a010 0x7fc3c8158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cd79b700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c8069860 0x7fc3c8165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 -- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c806a010 msgr2=0x7fc3c8158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3c806a010 0x7fc3c8158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 -- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c8069860 msgr2=0x7fc3c8165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3c8069860 0x7fc3c8165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 -- 172.21.15.53:0/2290013078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009420 con 0x7fc3c806a3e0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.372+0000 7fc3cdf9c700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c8168ba0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000cc20 tx=0x7fc3c00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.373+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000a900 con 0x7fc3c806a3e0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.373+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000aa60 con 0x7fc3c806a3e0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.373+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000ae20 con 0x7fc3c806a3e0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.373+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c8156bf0 con 0x7fc3c806a3e0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.373+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80c5d20 con 0x7fc3c806a3e0 2023-09-28T00:23:30.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.373+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3c80cbbc0 con 0x7fc3c806a3e0 2023-09-28T00:23:30.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.375+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc3c0007300 con 0x7fc3c806a3e0 2023-09-28T00:23:30.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.375+0000 7fc3bd7fa700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc3ac067360 0x7fc3ac069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3c0084f70 con 0x7fc3c806a3e0 2023-09-28T00:23:30.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3bd7fa700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7fc3ac06fc10 0x7fc3ac072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 --> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3ac0726d0 con 0x7fc3ac06fc10 2023-09-28T00:23:30.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c0087470 con 0x7fc3c806a3e0 2023-09-28T00:23:30.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3cd79b700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc3ac067360 0x7fc3ac069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3ccf9a700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7fc3ac06fc10 0x7fc3ac072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.376+0000 7fc3cd79b700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc3ac067360 0x7fc3ac069810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d10 tx=0x7fc3c40091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.377+0000 7fc3ccf9a700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7fc3ac06fc10 0x7fc3ac072020 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.377+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== osd.5 v2:172.21.15.118:6824/120751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc3ac0726d0 con 0x7fc3ac06fc10 2023-09-28T00:23:30.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.392+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 --> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3c8071830 con 0x7fc3ac06fc10 2023-09-28T00:23:30.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3bd7fa700 1 -- 172.21.15.53:0/2290013078 <== osd.5 v2:172.21.15.118:6824/120751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc3c8071830 con 0x7fc3ac06fc10 2023-09-28T00:23:30.394 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:30.394 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:30.394 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:30.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7fc3ac06fc10 msgr2=0x7fc3ac072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3ce79d700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6824/120751,v1:172.21.15.118:6825/120751] conn(0x7fc3ac06fc10 0x7fc3ac072020 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc3ac067360 msgr2=0x7fc3ac069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3ce79d700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fc3ac067360 0x7fc3ac069810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d10 tx=0x7fc3c40091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 msgr2=0x7fc3c8168ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3ce79d700 1 --2- 172.21.15.53:0/2290013078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c806a3e0 0x7fc3c8168ba0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000cc20 tx=0x7fc3c00019b0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.393+0000 7fc3cdf9c700 1 -- 172.21.15.53:0/2290013078 reap_dead start 2023-09-28T00:23:30.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.394+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 shutdown_connections 2023-09-28T00:23:30.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.394+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 >> 172.21.15.53:0/2290013078 conn(0x7fc3c80cbdc0 msgr2=0x7fc3c814f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:30.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.394+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 shutdown_connections 2023-09-28T00:23:30.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.394+0000 7fc3ce79d700 1 -- 172.21.15.53:0/2290013078 wait complete. 2023-09-28T00:23:30.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-28T00:23:30.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.598+0000 7f160a39d700 1 Processor -- start 2023-09-28T00:23:30.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.598+0000 7f160a39d700 1 -- start start 2023-09-28T00:23:30.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160a39d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1604151da0 0x7f16040c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160a39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406bf90 0x7f160414b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160a39d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160406eb10 con 0x7f160406f540 2023-09-28T00:23:30.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160a39d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040bf590 con 0x7f1604151da0 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160a39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160406bb00 con 0x7f160406bf90 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160939b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1604151da0 0x7f16040c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f1608b9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f160406f540 0x7f1604152170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59712/0 (socket says 172.21.15.53:59712) 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f1608b9a700 1 -- 172.21.15.53:0/425240042 learned_addr learned my addr 172.21.15.53:0/425240042 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f1609b9c700 1 --2- 172.21.15.53:0/425240042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406bf90 0x7f160414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160939b700 1 -- 172.21.15.53:0/425240042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406bf90 msgr2=0x7f160414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:30.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f15fbfff700 1 -- 172.21.15.53:0/425240042 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105366786 0 0) 0x7f160406eb10 con 0x7f160406f540 2023-09-28T00:23:30.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160939b700 1 --2- 172.21.15.53:0/425240042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406bf90 0x7f160414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160939b700 1 -- 172.21.15.53:0/425240042 >> v1:172.21.15.53:6789/0 conn(0x7f160406f540 legacy=0x7f1604152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.600+0000 7f160939b700 1 -- 172.21.15.53:0/425240042 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160406c430 con 0x7f1604151da0 2023-09-28T00:23:30.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.601+0000 7f160939b700 1 --2- 172.21.15.53:0/425240042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1604151da0 0x7f16040c24c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f16000098e0 tx=0x7f16000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866dba8d8230aad6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.601+0000 7f15fbfff700 1 -- 172.21.15.53:0/425240042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000b6d0 con 0x7f1604151da0 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.601+0000 7f15fbfff700 1 -- 172.21.15.53:0/425240042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000b830 con 0x7f1604151da0 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.601+0000 7f15fbfff700 1 -- 172.21.15.53:0/425240042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000bbd0 con 0x7f1604151da0 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.601+0000 7f160a39d700 1 -- 172.21.15.53:0/425240042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1604151da0 msgr2=0x7f16040c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.601+0000 7f160a39d700 1 --2- 172.21.15.53:0/425240042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1604151da0 0x7f16040c24c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f16000098e0 tx=0x7f16000091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.602+0000 7f160a39d700 1 -- 172.21.15.53:0/425240042 shutdown_connections 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.602+0000 7f160a39d700 1 --2- 172.21.15.53:0/425240042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406bf90 0x7f160414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.602+0000 7f160a39d700 1 --2- 172.21.15.53:0/425240042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1604151da0 0x7f16040c24c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.602+0000 7f160a39d700 1 -- 172.21.15.53:0/425240042 >> 172.21.15.53:0/425240042 conn(0x7f1604067630 msgr2=0x7f1604067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.602+0000 7f160a39d700 1 -- 172.21.15.53:0/425240042 shutdown_connections 2023-09-28T00:23:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.602+0000 7f160a39d700 1 -- 172.21.15.53:0/425240042 wait complete. 2023-09-28T00:23:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.603+0000 7f160a39d700 1 Processor -- start 2023-09-28T00:23:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.603+0000 7f160a39d700 1 -- start start 2023-09-28T00:23:30.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.604+0000 7f160a39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 0x7f16040c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.604+0000 7f160a39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406f540 0x7f16040c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.604+0000 7f160a39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604151da0 0x7f16041461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.604+0000 7f160a39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160414a6c0 con 0x7f160406bf90 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.604+0000 7f160a39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1604169700 con 0x7f1604151da0 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.604+0000 7f160a39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1604169270 con 0x7f160406f540 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 0x7f16040c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 0x7f16040c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40964/0 (socket says 172.21.15.53:40964) 2023-09-28T00:23:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 -- 172.21.15.53:0/2935964389 learned_addr learned my addr 172.21.15.53:0/2935964389 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f1609b9c700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604151da0 0x7f16041461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f1608b9a700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406f540 0x7f16040c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 -- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406f540 msgr2=0x7f16040c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406f540 0x7f16040c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 -- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604151da0 msgr2=0x7f16041461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604151da0 0x7f16041461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 -- 172.21.15.53:0/2935964389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009420 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f160939b700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 0x7f16040c4520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1600009f80 tx=0x7f1600018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.605+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000bbb0 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.606+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600000c90 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.606+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040c73e0 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.606+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600023630 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.606+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1604168c20 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.607+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160404c3c0 con 0x7f160406bf90 2023-09-28T00:23:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.608+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f16000103f0 con 0x7f160406bf90 2023-09-28T00:23:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.609+0000 7f15f97fa700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f15e8067360 0x7f15e8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.609+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1600085e10 con 0x7f160406bf90 2023-09-28T00:23:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.609+0000 7f1608b9a700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f15e8067360 0x7f15e8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.610+0000 7f1608b9a700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f15e8067360 0x7f15e8069810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16040c1f20 tx=0x7f15f4007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.613+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1600052d10 con 0x7f160406bf90 2023-09-28T00:23:30.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.815+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f16040c22c0 con 0x7f15e8067360 2023-09-28T00:23:30.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.815+0000 7f15f97fa700 1 -- 172.21.15.53:0/2935964389 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f16040c22c0 con 0x7f15e8067360 2023-09-28T00:23:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f15e8067360 msgr2=0x7f15e8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f15e8067360 0x7f15e8069810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f16040c1f20 tx=0x7f15f4007d30 comp rx=0 tx=0).stop 2023-09-28T00:23:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 msgr2=0x7f16040c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 0x7f16040c4520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1600009f80 tx=0x7f1600018000 comp rx=0 tx=0).stop 2023-09-28T00:23:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 shutdown_connections 2023-09-28T00:23:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f15e8067360 0x7f15e8069810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604151da0 0x7f16041461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160406bf90 0x7f16040c4520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 --2- 172.21.15.53:0/2935964389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f160406f540 0x7f16040c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:30.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 >> 172.21.15.53:0/2935964389 conn(0x7f1604067630 msgr2=0x7f160414b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:30.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 shutdown_connections 2023-09-28T00:23:30.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:30.818+0000 7f160a39d700 1 -- 172.21.15.53:0/2935964389 wait complete. 2023-09-28T00:23:30.821 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 5 to deep-scrub 2023-09-28T00:23:30.836 INFO:tasks.ceph:Scrubbing osd.6 2023-09-28T00:23:30.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:31.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.026+0000 7fa16ffff700 1 Processor -- start 2023-09-28T00:23:31.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.026+0000 7fa16ffff700 1 -- start start 2023-09-28T00:23:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.027+0000 7fa16ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa1700ad910 0x7fa170158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.027+0000 7fa16ffff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1700adce0 0x7fa1700ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.027+0000 7fa16ffff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170157ba0 con 0x7fa170158570 2023-09-28T00:23:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.027+0000 7fa16ffff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1701534e0 con 0x7fa1700adce0 2023-09-28T00:23:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.027+0000 7fa16ffff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa170156450 con 0x7fa1700ad910 2023-09-28T00:23:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.027+0000 7fa16e7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1700adce0 0x7fa1700ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1700adce0 0x7fa1700ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40978/0 (socket says 172.21.15.53:40978) 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 -- 172.21.15.53:0/994490184 learned_addr learned my addr 172.21.15.53:0/994490184 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16effd700 1 --2- 172.21.15.53:0/994490184 >> v2:172.21.15.118:3300/0 conn(0x7fa1700ad910 0x7fa170158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 -- 172.21.15.53:0/994490184 >> v2:172.21.15.118:3300/0 conn(0x7fa1700ad910 msgr2=0x7fa170158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 --2- 172.21.15.53:0/994490184 >> v2:172.21.15.118:3300/0 conn(0x7fa1700ad910 0x7fa170158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 -- 172.21.15.53:0/994490184 >> v1:172.21.15.118:6789/0 conn(0x7fa170158570 legacy=0x7fa1700abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 -- 172.21.15.53:0/994490184 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1701569f0 con 0x7fa1700adce0 2023-09-28T00:23:31.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16e7fc700 1 --2- 172.21.15.53:0/994490184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa1700ab5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa170089660 tx=0x7fa164009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba7e607e93ffaed server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16dffb700 1 -- 172.21.15.53:0/994490184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16400b860 con 0x7fa1700adce0 2023-09-28T00:23:31.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16dffb700 1 -- 172.21.15.53:0/994490184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16400b9c0 con 0x7fa1700adce0 2023-09-28T00:23:31.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.028+0000 7fa16dffb700 1 -- 172.21.15.53:0/994490184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16400bd60 con 0x7fa1700adce0 2023-09-28T00:23:31.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 -- 172.21.15.53:0/994490184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 msgr2=0x7fa1700ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 --2- 172.21.15.53:0/994490184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa1700ab5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa170089660 tx=0x7fa164009250 comp rx=0 tx=0).stop 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 -- 172.21.15.53:0/994490184 shutdown_connections 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 --2- 172.21.15.53:0/994490184 >> v2:172.21.15.118:3300/0 conn(0x7fa1700ad910 0x7fa170158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 --2- 172.21.15.53:0/994490184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa1700ab5f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 -- 172.21.15.53:0/994490184 >> 172.21.15.53:0/994490184 conn(0x7fa1700cbdc0 msgr2=0x7fa1700cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 -- 172.21.15.53:0/994490184 shutdown_connections 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.029+0000 7fa16ffff700 1 -- 172.21.15.53:0/994490184 wait complete. 2023-09-28T00:23:31.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.030+0000 7fa16ffff700 1 Processor -- start 2023-09-28T00:23:31.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.031+0000 7fa16ffff700 1 -- start start 2023-09-28T00:23:31.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700ad910 0x7fa170068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa170068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa170158570 0x7fa1700b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16ffff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170168ce0 con 0x7fa1700adce0 2023-09-28T00:23:31.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16ffff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170168f80 con 0x7fa1700ad910 2023-09-28T00:23:31.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16ffff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700cbb40 con 0x7fa170158570 2023-09-28T00:23:31.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa170068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa170068030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40992/0 (socket says 172.21.15.53:40992) 2023-09-28T00:23:31.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 -- 172.21.15.53:0/2315521439 learned_addr learned my addr 172.21.15.53:0/2315521439 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16effd700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700ad910 0x7fa170068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16f7fe700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa170158570 0x7fa1700b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 -- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa170158570 msgr2=0x7fa1700b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa170158570 0x7fa1700b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 -- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700ad910 msgr2=0x7fa170068a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700ad910 0x7fa170068a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.032+0000 7fa16e7fc700 1 -- 172.21.15.53:0/2315521439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640094f0 con 0x7fa1700adce0 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.033+0000 7fa16e7fc700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa170068030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1700899a0 tx=0x7fa164017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.033+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164024440 con 0x7fa1700adce0 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.033+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1640245a0 con 0x7fa1700adce0 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.033+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa170169240 con 0x7fa1700adce0 2023-09-28T00:23:31.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.033+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164024960 con 0x7fa1700adce0 2023-09-28T00:23:31.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.033+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa170169800 con 0x7fa1700adce0 2023-09-28T00:23:31.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.034+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa170071830 con 0x7fa1700adce0 2023-09-28T00:23:31.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.035+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa16401a420 con 0x7fa1700adce0 2023-09-28T00:23:31.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa156ffd700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa15c067360 0x7fa15c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa164086f50 con 0x7fa1700adce0 2023-09-28T00:23:31.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa156ffd700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fa15c06fc10 0x7fa15c072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 --> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa15c0726d0 con 0x7fa15c06fc10 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa164087240 con 0x7fa1700adce0 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa16effd700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa15c067360 0x7fa15c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.036+0000 7fa16f7fe700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fa15c06fc10 0x7fa15c072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.037+0000 7fa16effd700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa15c067360 0x7fa15c069810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa160006fd0 tx=0x7fa160008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.037+0000 7fa16f7fe700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fa15c06fc10 0x7fa15c072020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.038+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== osd.6 v2:172.21.15.118:6808/120722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa15c0726d0 con 0x7fa15c06fc10 2023-09-28T00:23:31.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.052+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 --> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa170156cb0 con 0x7fa15c06fc10 2023-09-28T00:23:31.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.053+0000 7fa156ffd700 1 -- 172.21.15.53:0/2315521439 <== osd.6 v2:172.21.15.118:6808/120722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa170156cb0 con 0x7fa15c06fc10 2023-09-28T00:23:31.054 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:31.054 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:31.055 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:31.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fa15c06fc10 msgr2=0x7fa15c072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6808/120722,v1:172.21.15.118:6809/120722] conn(0x7fa15c06fc10 0x7fa15c072020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa15c067360 msgr2=0x7fa15c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa15c067360 0x7fa15c069810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa160006fd0 tx=0x7fa160008040 comp rx=0 tx=0).stop 2023-09-28T00:23:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 msgr2=0x7fa170068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 --2- 172.21.15.53:0/2315521439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1700adce0 0x7fa170068030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1700899a0 tx=0x7fa164017000 comp rx=0 tx=0).stop 2023-09-28T00:23:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16f7fe700 1 -- 172.21.15.53:0/2315521439 reap_dead start 2023-09-28T00:23:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 shutdown_connections 2023-09-28T00:23:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 >> 172.21.15.53:0/2315521439 conn(0x7fa1700cbdc0 msgr2=0x7fa17014e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 shutdown_connections 2023-09-28T00:23:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.054+0000 7fa16ffff700 1 -- 172.21.15.53:0/2315521439 wait complete. 2023-09-28T00:23:31.071 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-28T00:23:31.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.260+0000 7fe3b319d700 1 Processor -- start 2023-09-28T00:23:31.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.261+0000 7fe3b319d700 1 -- start start 2023-09-28T00:23:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b319d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3ac0c1640 0x7fe3ac0c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b319d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d970 0x7fe3ac156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b319d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ac156af0 con 0x7fe3ac14d5a0 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b319d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3ac154410 con 0x7fe3ac0c1640 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b319d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac153eb0 con 0x7fe3ac14d970 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b199a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3ac0c1640 0x7fe3ac0c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b199a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3ac0c1640 0x7fe3ac0c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41004/0 (socket says 172.21.15.53:41004) 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b199a700 1 -- 172.21.15.53:0/1869922509 learned_addr learned my addr 172.21.15.53:0/1869922509 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.262+0000 7fe3b299c700 1 --2- 172.21.15.53:0/1869922509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d970 0x7fe3ac156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b199a700 1 -- 172.21.15.53:0/1869922509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d970 msgr2=0x7fe3ac156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b199a700 1 --2- 172.21.15.53:0/1869922509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d970 0x7fe3ac156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b199a700 1 -- 172.21.15.53:0/1869922509 >> v1:172.21.15.118:6789/0 conn(0x7fe3ac14d5a0 legacy=0x7fe3ac0c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b199a700 1 -- 172.21.15.53:0/1869922509 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac154130 con 0x7fe3ac0c1640 2023-09-28T00:23:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b1199700 1 -- 172.21.15.53:0/1869922509 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130189020 0 0) 0x7fe3ac156af0 con 0x7fe3ac14d5a0 2023-09-28T00:23:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b199a700 1 --2- 172.21.15.53:0/1869922509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac0c22b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0099b0 tx=0x7fe39c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae16897fdae50c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b1199700 1 -- 172.21.15.53:0/1869922509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c009ea0 con 0x7fe3ac0c1640 2023-09-28T00:23:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b1199700 1 -- 172.21.15.53:0/1869922509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00b860 con 0x7fe3ac0c1640 2023-09-28T00:23:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.263+0000 7fe3b1199700 1 -- 172.21.15.53:0/1869922509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00bc00 con 0x7fe3ac0c1640 2023-09-28T00:23:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 -- 172.21.15.53:0/1869922509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac0c1640 msgr2=0x7fe3ac0c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 --2- 172.21.15.53:0/1869922509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac0c22b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0099b0 tx=0x7fe39c009250 comp rx=0 tx=0).stop 2023-09-28T00:23:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 -- 172.21.15.53:0/1869922509 shutdown_connections 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 --2- 172.21.15.53:0/1869922509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d970 0x7fe3ac156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 --2- 172.21.15.53:0/1869922509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac0c22b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 -- 172.21.15.53:0/1869922509 >> 172.21.15.53:0/1869922509 conn(0x7fe3ac067630 msgr2=0x7fe3ac067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 -- 172.21.15.53:0/1869922509 shutdown_connections 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.264+0000 7fe3b319d700 1 -- 172.21.15.53:0/1869922509 wait complete. 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.265+0000 7fe3b319d700 1 Processor -- start 2023-09-28T00:23:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.266+0000 7fe3b319d700 1 -- start start 2023-09-28T00:23:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.266+0000 7fe3b319d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac165c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b319d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d5a0 0x7fe3ac1690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b319d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 0x7fe3ac06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b319d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac169630 con 0x7fe3ac14d970 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b319d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac168c60 con 0x7fe3ac0c1640 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b319d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac0bfb60 con 0x7fe3ac14d5a0 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 0x7fe3ac06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 0x7fe3ac06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41020/0 (socket says 172.21.15.53:41020) 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 -- 172.21.15.53:0/2870405461 learned_addr learned my addr 172.21.15.53:0/2870405461 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b199a700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d5a0 0x7fe3ac1690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b219b700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac165c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 -- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d5a0 msgr2=0x7fe3ac1690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d5a0 0x7fe3ac1690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 -- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3ac0c1640 msgr2=0x7fe3ac165c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac165c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.267+0000 7fe3b299c700 1 -- 172.21.15.53:0/2870405461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0094f0 con 0x7fe3ac14d970 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.268+0000 7fe3b299c700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 0x7fe3ac06e000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009d70 tx=0x7fe3a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.268+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400caa0 con 0x7fe3ac14d970 2023-09-28T00:23:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.268+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a400f040 con 0x7fe3ac14d970 2023-09-28T00:23:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.268+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a400ce50 con 0x7fe3ac14d970 2023-09-28T00:23:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.268+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac0bfe40 con 0x7fe3ac14d970 2023-09-28T00:23:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.268+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac1688f0 con 0x7fe3ac14d970 2023-09-28T00:23:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.269+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ac168750 con 0x7fe3ac14d970 2023-09-28T00:23:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.270+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe3a4014690 con 0x7fe3ac14d970 2023-09-28T00:23:31.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.270+0000 7fe3a27fc700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe390067330 0x7fe3900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.271+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3a4085740 con 0x7fe3ac14d970 2023-09-28T00:23:31.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.271+0000 7fe3b219b700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe390067330 0x7fe3900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.271+0000 7fe3b219b700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe390067330 0x7fe3900697e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8007fd0 tx=0x7fe3a8007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.275+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe3ac168750 con 0x7fe3ac14d970 2023-09-28T00:23:31.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.477+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3ac168750 con 0x7fe390067330 2023-09-28T00:23:31.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.478+0000 7fe3a27fc700 1 -- 172.21.15.53:0/2870405461 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe3ac168750 con 0x7fe390067330 2023-09-28T00:23:31.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe390067330 msgr2=0x7fe3900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe390067330 0x7fe3900697e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8007fd0 tx=0x7fe3a8007d30 comp rx=0 tx=0).stop 2023-09-28T00:23:31.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 msgr2=0x7fe3ac06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 0x7fe3ac06e000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009d70 tx=0x7fe3a400b040 comp rx=0 tx=0).stop 2023-09-28T00:23:31.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 shutdown_connections 2023-09-28T00:23:31.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fe390067330 0x7fe3900697e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3ac14d970 0x7fe3ac06e000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3ac0c1640 0x7fe3ac165c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 --2- 172.21.15.53:0/2870405461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3ac14d5a0 0x7fe3ac1690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 >> 172.21.15.53:0/2870405461 conn(0x7fe3ac067630 msgr2=0x7fe3ac0c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 shutdown_connections 2023-09-28T00:23:31.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.480+0000 7fe3b319d700 1 -- 172.21.15.53:0/2870405461 wait complete. 2023-09-28T00:23:31.483 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 6 to deep-scrub 2023-09-28T00:23:31.499 INFO:tasks.ceph:Scrubbing osd.7 2023-09-28T00:23:31.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:23:31.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.690+0000 7fead579d700 1 Processor -- start 2023-09-28T00:23:31.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.690+0000 7fead579d700 1 -- start start 2023-09-28T00:23:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead579d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fead006a010 0x7fead00ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead579d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a3e0 0x7fead00abb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead579d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 0x7fead014f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead579d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00ac0e0 con 0x7fead0069860 2023-09-28T00:23:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead579d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead0156390 con 0x7fead006a010 2023-09-28T00:23:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead579d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0155520 con 0x7fead006a3e0 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead4f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 0x7fead014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7feacffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fead006a010 0x7fead00ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7feacf7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a3e0 0x7fead00abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead4f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 0x7fead014f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41030/0 (socket says 172.21.15.53:41030) 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.691+0000 7fead4f9c700 1 -- 172.21.15.53:0/491798498 learned_addr learned my addr 172.21.15.53:0/491798498 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feacf7fe700 1 -- 172.21.15.53:0/491798498 >> v2:172.21.15.118:3300/0 conn(0x7fead006a010 msgr2=0x7fead00ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feacf7fe700 1 --2- 172.21.15.53:0/491798498 >> v2:172.21.15.118:3300/0 conn(0x7fead006a010 0x7fead00ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feacf7fe700 1 -- 172.21.15.53:0/491798498 >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 msgr2=0x7fead014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feacf7fe700 1 --2- 172.21.15.53:0/491798498 >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 0x7fead014f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feacf7fe700 1 -- 172.21.15.53:0/491798498 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0155710 con 0x7fead006a3e0 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7fead4f9c700 1 --2- 172.21.15.53:0/491798498 >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 0x7fead014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feacf7fe700 1 --2- 172.21.15.53:0/491798498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a3e0 0x7fead00abb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fead00c2f60 tx=0x7feac40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41c32af7e193b2b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.692+0000 7feaceffd700 1 -- 172.21.15.53:0/491798498 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4011630 con 0x7fead006a3e0 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7feaceffd700 1 -- 172.21.15.53:0/491798498 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac40117b0 con 0x7fead006a3e0 2023-09-28T00:23:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7feaceffd700 1 -- 172.21.15.53:0/491798498 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4011b70 con 0x7fead006a3e0 2023-09-28T00:23:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 -- 172.21.15.53:0/491798498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a3e0 msgr2=0x7fead00abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 --2- 172.21.15.53:0/491798498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a3e0 0x7fead00abb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fead00c2f60 tx=0x7feac40091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 -- 172.21.15.53:0/491798498 shutdown_connections 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 --2- 172.21.15.53:0/491798498 >> v2:172.21.15.53:3300/0 conn(0x7fead0069860 0x7fead014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 --2- 172.21.15.53:0/491798498 >> v2:172.21.15.118:3300/0 conn(0x7fead006a010 0x7fead00ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 --2- 172.21.15.53:0/491798498 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a3e0 0x7fead00abb00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 -- 172.21.15.53:0/491798498 >> 172.21.15.53:0/491798498 conn(0x7fead00cbdc0 msgr2=0x7fead00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 -- 172.21.15.53:0/491798498 shutdown_connections 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.693+0000 7fead579d700 1 -- 172.21.15.53:0/491798498 wait complete. 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.695+0000 7fead579d700 1 Processor -- start 2023-09-28T00:23:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.695+0000 7fead579d700 1 -- start start 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead579d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead0069860 0x7fead015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead579d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a010 0x7fead014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead579d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead006a3e0 0x7fead00c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead579d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead015bcd0 con 0x7fead0069860 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead579d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00c3ae0 con 0x7fead006a3e0 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead579d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead014ca40 con 0x7fead006a010 2023-09-28T00:23:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7feacffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead0069860 0x7fead015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead4f9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead006a3e0 0x7fead00c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7feacf7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a010 0x7fead014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead4f9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead006a3e0 0x7fead00c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:42794/0 (socket says 172.21.15.53:42794) 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7feacffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead0069860 0x7fead015b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41042/0 (socket says 172.21.15.53:41042) 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.696+0000 7fead4f9c700 1 -- 172.21.15.53:0/1628429974 learned_addr learned my addr 172.21.15.53:0/1628429974 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead4f9c700 1 -- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a010 msgr2=0x7fead014c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead4f9c700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fead006a010 0x7fead014c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead4f9c700 1 -- 172.21.15.53:0/1628429974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead0069860 msgr2=0x7fead015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead4f9c700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead0069860 0x7fead015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead4f9c700 1 -- 172.21.15.53:0/1628429974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8009ae0 con 0x7fead006a3e0 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead4f9c700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead006a3e0 0x7fead00c73b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feac8009fd0 tx=0x7feac800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8018070 con 0x7fead006a3e0 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800f040 con 0x7fead006a3e0 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800cbd0 con 0x7fead006a3e0 2023-09-28T00:23:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac4009420 con 0x7fead006a3e0 2023-09-28T00:23:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.697+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead00c31b0 con 0x7fead006a3e0 2023-09-28T00:23:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.698+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fead0071830 con 0x7fead006a3e0 2023-09-28T00:23:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.699+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7feac8003020 con 0x7fead006a3e0 2023-09-28T00:23:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.700+0000 7feab7fff700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7feabc067360 0x7feabc069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.700+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feac80851f0 con 0x7fead006a3e0 2023-09-28T00:23:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.700+0000 7feacffff700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7feabc067360 0x7feabc069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.700+0000 7feab7fff700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7feabc06fc10 0x7feabc072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.700+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 --> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feabc0726d0 con 0x7feabc06fc10 2023-09-28T00:23:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.700+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac80854e0 con 0x7fead006a3e0 2023-09-28T00:23:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.701+0000 7feacf7fe700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7feabc06fc10 0x7feabc072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.701+0000 7feacffff700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7feabc067360 0x7feabc069810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feac0009db0 tx=0x7feac00091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.701+0000 7feacf7fe700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7feabc06fc10 0x7feabc072020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.702+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== osd.7 v2:172.21.15.118:6816/120752 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7feabc0726d0 con 0x7feabc06fc10 2023-09-28T00:23:31.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.720+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 --> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fead01559f0 con 0x7feabc06fc10 2023-09-28T00:23:31.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.720+0000 7feab7fff700 1 -- 172.21.15.53:0/1628429974 <== osd.7 v2:172.21.15.118:6816/120752 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fead01559f0 con 0x7feabc06fc10 2023-09-28T00:23:31.721 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-28T00:23:31.722 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:23:31.722 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-28T00:23:31.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7feabc06fc10 msgr2=0x7feabc072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6816/120752,v1:172.21.15.118:6817/120752] conn(0x7feabc06fc10 0x7feabc072020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7feabc067360 msgr2=0x7feabc069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7feabc067360 0x7feabc069810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feac0009db0 tx=0x7feac00091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead006a3e0 msgr2=0x7fead00c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 --2- 172.21.15.53:0/1628429974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fead006a3e0 0x7fead00c73b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feac8009fd0 tx=0x7feac800b040 comp rx=0 tx=0).stop 2023-09-28T00:23:31.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead4f9c700 1 -- 172.21.15.53:0/1628429974 reap_dead start 2023-09-28T00:23:31.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 shutdown_connections 2023-09-28T00:23:31.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 >> 172.21.15.53:0/1628429974 conn(0x7fead00cbdc0 msgr2=0x7fead0063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 shutdown_connections 2023-09-28T00:23:31.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.721+0000 7fead579d700 1 -- 172.21.15.53:0/1628429974 wait complete. 2023-09-28T00:23:31.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-28T00:23:31.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.925+0000 7f9b4e39d700 1 Processor -- start 2023-09-28T00:23:31.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.925+0000 7f9b4e39d700 1 -- start start 2023-09-28T00:23:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4e39d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b480c4fe0 0x7f9b480bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4e39d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b480c0d60 0x7f9b4814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4e39d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b48156a00 con 0x7f9b480c0990 2023-09-28T00:23:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4e39d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b48156560 con 0x7f9b480c0d60 2023-09-28T00:23:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4e39d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b480bf260 con 0x7f9b480c4fe0 2023-09-28T00:23:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4d39b700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b480c0990 0x7f9b48152ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59722/0 (socket says 172.21.15.53:59722) 2023-09-28T00:23:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4d39b700 1 -- 172.21.15.53:0/2965350145 learned_addr learned my addr 172.21.15.53:0/2965350145 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4db9c700 1 --2- 172.21.15.53:0/2965350145 >> v2:172.21.15.53:3300/0 conn(0x7f9b480c0d60 0x7f9b4814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4cb9a700 1 --2- 172.21.15.53:0/2965350145 >> v2:172.21.15.118:3300/0 conn(0x7f9b480c4fe0 0x7f9b480bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b3ffff700 1 -- 172.21.15.53:0/2965350145 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010029430 0 0) 0x7f9b48156a00 con 0x7f9b480c0990 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b3ffff700 1 -- 172.21.15.53:0/2965350145 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b34003570 con 0x7f9b480c0990 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4db9c700 1 -- 172.21.15.53:0/2965350145 >> v2:172.21.15.118:3300/0 conn(0x7f9b480c4fe0 msgr2=0x7f9b480bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4db9c700 1 --2- 172.21.15.53:0/2965350145 >> v2:172.21.15.118:3300/0 conn(0x7f9b480c4fe0 0x7f9b480bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4db9c700 1 -- 172.21.15.53:0/2965350145 >> v1:172.21.15.53:6789/0 conn(0x7f9b480c0990 legacy=0x7f9b48152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.927+0000 7f9b4db9c700 1 -- 172.21.15.53:0/2965350145 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48152a10 con 0x7f9b480c0d60 2023-09-28T00:23:31.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.928+0000 7f9b4db9c700 1 --2- 172.21.15.53:0/2965350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0d60 0x7f9b4814bfe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009e60 tx=0x7f9b40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f843358e2b2a8c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.928+0000 7f9b3ffff700 1 -- 172.21.15.53:0/2965350145 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000e070 con 0x7f9b480c0d60 2023-09-28T00:23:31.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.928+0000 7f9b3ffff700 1 -- 172.21.15.53:0/2965350145 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4000ba70 con 0x7f9b480c0d60 2023-09-28T00:23:31.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.928+0000 7f9b3ffff700 1 -- 172.21.15.53:0/2965350145 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000be30 con 0x7f9b480c0d60 2023-09-28T00:23:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.928+0000 7f9b4e39d700 1 -- 172.21.15.53:0/2965350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0d60 msgr2=0x7f9b4814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.928+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/2965350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0d60 0x7f9b4814bfe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009e60 tx=0x7f9b40009780 comp rx=0 tx=0).stop 2023-09-28T00:23:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.929+0000 7f9b4e39d700 1 -- 172.21.15.53:0/2965350145 shutdown_connections 2023-09-28T00:23:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.929+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/2965350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0d60 0x7f9b4814bfe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.929+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/2965350145 >> v2:172.21.15.118:3300/0 conn(0x7f9b480c4fe0 0x7f9b480bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.929+0000 7f9b4e39d700 1 -- 172.21.15.53:0/2965350145 >> 172.21.15.53:0/2965350145 conn(0x7f9b48067630 msgr2=0x7f9b48067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.929+0000 7f9b4e39d700 1 -- 172.21.15.53:0/2965350145 shutdown_connections 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.929+0000 7f9b4e39d700 1 -- 172.21.15.53:0/2965350145 wait complete. 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.930+0000 7f9b4e39d700 1 Processor -- start 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.930+0000 7f9b4e39d700 1 -- start start 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.931+0000 7f9b4e39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 0x7f9b480c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.931+0000 7f9b4e39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b480c0d60 0x7f9b48150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.931+0000 7f9b4e39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b480c4fe0 0x7f9b48151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.931+0000 7f9b4e39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48150360 con 0x7f9b480c0990 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.931+0000 7f9b4e39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48151bf0 con 0x7f9b480c0d60 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.931+0000 7f9b4e39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b481693c0 con 0x7f9b480c4fe0 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 0x7f9b480c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 0x7f9b480c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41054/0 (socket says 172.21.15.53:41054) 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4cb9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b480c0d60 0x7f9b48150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 -- 172.21.15.53:0/478035992 learned_addr learned my addr 172.21.15.53:0/478035992 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4db9c700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b480c4fe0 0x7f9b48151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 -- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b480c4fe0 msgr2=0x7f9b48151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b480c4fe0 0x7f9b48151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 -- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b480c0d60 msgr2=0x7f9b48150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b480c0d60 0x7f9b48150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 -- 172.21.15.53:0/478035992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40009a20 con 0x7f9b480c0990 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.932+0000 7f9b4d39b700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 0x7f9b480c6a60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c7f0 tx=0x7f9b44007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.933+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44005cd0 con 0x7f9b480c0990 2023-09-28T00:23:31.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.933+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44005e50 con 0x7f9b480c0990 2023-09-28T00:23:31.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.933+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44007320 con 0x7f9b480c0990 2023-09-28T00:23:31.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.933+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b48169630 con 0x7f9b480c0990 2023-09-28T00:23:31.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.933+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4806e7e0 con 0x7f9b480c0990 2023-09-28T00:23:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.934+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4804c3c0 con 0x7f9b480c0990 2023-09-28T00:23:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.935+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9b4401b3b0 con 0x7f9b480c0990 2023-09-28T00:23:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.935+0000 7f9b3d7fa700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9b2c067360 0x7f9b2c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.935+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b440842a0 con 0x7f9b480c0990 2023-09-28T00:23:31.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.936+0000 7f9b4cb9a700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9b2c067360 0x7f9b2c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.936+0000 7f9b4cb9a700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9b2c067360 0x7f9b2c069810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b48147e00 tx=0x7f9b380091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:31.939+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b44051100 con 0x7f9b480c0990 2023-09-28T00:23:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.146+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b4806ed90 con 0x7f9b2c067360 2023-09-28T00:23:32.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.147+0000 7f9b3d7fa700 1 -- 172.21.15.53:0/478035992 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9b4806ed90 con 0x7f9b2c067360 2023-09-28T00:23:32.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9b2c067360 msgr2=0x7f9b2c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9b2c067360 0x7f9b2c069810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b48147e00 tx=0x7f9b380091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 msgr2=0x7f9b480c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 0x7f9b480c6a60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400c7f0 tx=0x7f9b44007e00 comp rx=0 tx=0).stop 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 shutdown_connections 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9b2c067360 0x7f9b2c069810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b480c4fe0 0x7f9b48151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b480c0990 0x7f9b480c6a60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 --2- 172.21.15.53:0/478035992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b480c0d60 0x7f9b48150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 >> 172.21.15.53:0/478035992 conn(0x7f9b48067630 msgr2=0x7f9b480c11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:32.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 shutdown_connections 2023-09-28T00:23:32.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.149+0000 7f9b4e39d700 1 -- 172.21.15.53:0/478035992 wait complete. 2023-09-28T00:23:32.152 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 7 to deep-scrub 2023-09-28T00:23:32.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:32.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.354+0000 7f5ae119d700 1 Processor -- start 2023-09-28T00:23:32.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.354+0000 7f5ae119d700 1 -- start start 2023-09-28T00:23:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5ae119d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5adc0c8bf0 0x7f5adc06c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5ae119d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8fc0 0x7f5adc0c5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5ae119d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0684e0 con 0x7f5adc0c3e10 2023-09-28T00:23:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5ae119d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc1553f0 con 0x7f5adc0c8bf0 2023-09-28T00:23:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5ae119d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc1555e0 con 0x7f5adc0c8fc0 2023-09-28T00:23:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5adbfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5adc0c8bf0 0x7f5adc06c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.355+0000 7f5ae099c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8fc0 0x7f5adc0c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5adc0c8bf0 0x7f5adc06c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:42806/0 (socket says 172.21.15.53:42806) 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5ae099c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8fc0 0x7f5adc0c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:34336/0 (socket says 172.21.15.53:34336) 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 -- 172.21.15.53:0/3720993015 learned_addr learned my addr 172.21.15.53:0/3720993015 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adb7fe700 1 --1- 172.21.15.53:0/3720993015 >> v1:172.21.15.53:6789/0 conn(0x7f5adc0c3e10 0x7f5adc0c2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59736/0 (socket says 172.21.15.53:59736) 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 -- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8fc0 msgr2=0x7f5adc0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 --2- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8fc0 0x7f5adc0c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 -- 172.21.15.53:0/3720993015 >> v1:172.21.15.53:6789/0 conn(0x7f5adc0c3e10 legacy=0x7f5adc0c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 -- 172.21.15.53:0/3720993015 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc1558c0 con 0x7f5adc0c8bf0 2023-09-28T00:23:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adaffd700 1 -- 172.21.15.53:0/3720993015 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317875441 0 0) 0x7f5adc0684e0 con 0x7f5adc0c3e10 2023-09-28T00:23:32.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adbfff700 1 --2- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c8bf0 0x7f5adc06c2e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0099b0 tx=0x7f5acc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b3a36ff28f901f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adaffd700 1 -- 172.21.15.53:0/3720993015 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc009ea0 con 0x7f5adc0c8bf0 2023-09-28T00:23:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adaffd700 1 -- 172.21.15.53:0/3720993015 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00b8f0 con 0x7f5adc0c8bf0 2023-09-28T00:23:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.356+0000 7f5adaffd700 1 -- 172.21.15.53:0/3720993015 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00bc90 con 0x7f5adc0c8bf0 2023-09-28T00:23:32.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 -- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c8bf0 msgr2=0x7f5adc06c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 --2- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c8bf0 0x7f5adc06c2e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0099b0 tx=0x7f5acc009250 comp rx=0 tx=0).stop 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 -- 172.21.15.53:0/3720993015 shutdown_connections 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 --2- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8fc0 0x7f5adc0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 --2- 172.21.15.53:0/3720993015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c8bf0 0x7f5adc06c2e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 -- 172.21.15.53:0/3720993015 >> 172.21.15.53:0/3720993015 conn(0x7f5adc06a990 msgr2=0x7f5adc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 -- 172.21.15.53:0/3720993015 shutdown_connections 2023-09-28T00:23:32.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.357+0000 7f5ae119d700 1 -- 172.21.15.53:0/3720993015 wait complete. 2023-09-28T00:23:32.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.359+0000 7f5ae119d700 1 Processor -- start 2023-09-28T00:23:32.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.359+0000 7f5ae119d700 1 -- start start 2023-09-28T00:23:32.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae119d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 0x7f5adc0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae119d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8bf0 0x7f5adc165970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae119d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc0c8fc0 0x7f5adc168830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae119d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc15a960 con 0x7f5adc0c8fc0 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae119d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0c7200 con 0x7f5adc0c3e10 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae119d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc159de0 con 0x7f5adc0c8bf0 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5adbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 0x7f5adc0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:32.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.360+0000 7f5ae099c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc0c8fc0 0x7f5adc168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 0x7f5adc0c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:42810/0 (socket says 172.21.15.53:42810) 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 -- 172.21.15.53:0/1493157953 learned_addr learned my addr 172.21.15.53:0/1493157953 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adb7fe700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8bf0 0x7f5adc165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 -- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8bf0 msgr2=0x7f5adc165970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8bf0 0x7f5adc165970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 -- 172.21.15.53:0/1493157953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc0c8fc0 msgr2=0x7f5adc168830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc0c8fc0 0x7f5adc168830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 -- 172.21.15.53:0/1493157953 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0094f0 con 0x7f5adc0c3e10 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.361+0000 7f5adbfff700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 0x7f5adc0c7e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006fd0 tx=0x7f5acc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.362+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00ba60 con 0x7f5adc0c3e10 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.362+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00bbc0 con 0x7f5adc0c3e10 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.362+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc026660 con 0x7f5adc0c3e10 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.362+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc15a0c0 con 0x7f5adc0c3e10 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.362+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc15a680 con 0x7f5adc0c3e10 2023-09-28T00:23:32.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.363+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc0c9830 con 0x7f5adc0c3e10 2023-09-28T00:23:32.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.364+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5acc023030 con 0x7f5adc0c3e10 2023-09-28T00:23:32.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.365+0000 7f5ac3fff700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ac8067330 0x7f5ac80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.365+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5acc085c90 con 0x7f5adc0c3e10 2023-09-28T00:23:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.365+0000 7f5adb7fe700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ac8067330 0x7f5ac80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:32.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.366+0000 7f5adb7fe700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ac8067330 0x7f5ac80697e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0bf540 tx=0x7f5ad0007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:32.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.368+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5acc052bf0 con 0x7f5adc0c3e10 2023-09-28T00:23:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.566+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5adc04c3c0 con 0x7f5ac8067330 2023-09-28T00:23:32.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.576+0000 7f5ac3fff700 1 -- 172.21.15.53:0/1493157953 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283649 (secure 0 0 0) 0x7f5adc04c3c0 con 0x7f5ac8067330 2023-09-28T00:23:32.580 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:32.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ac8067330 msgr2=0x7f5ac80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ac8067330 0x7f5ac80697e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0bf540 tx=0x7f5ad0007d50 comp rx=0 tx=0).stop 2023-09-28T00:23:32.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 msgr2=0x7f5adc0c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:32.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 0x7f5adc0c7e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006fd0 tx=0x7f5acc017000 comp rx=0 tx=0).stop 2023-09-28T00:23:32.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 shutdown_connections 2023-09-28T00:23:32.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5ac8067330 0x7f5ac80697e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc0c8fc0 0x7f5adc168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5adc0c3e10 0x7f5adc0c7e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 --2- 172.21.15.53:0/1493157953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5adc0c8bf0 0x7f5adc165970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 >> 172.21.15.53:0/1493157953 conn(0x7f5adc06a990 msgr2=0x7f5adc14d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 shutdown_connections 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:32.580+0000 7f5ae119d700 1 -- 172.21.15.53:0/1493157953 wait complete. 2023-09-28T00:23:32.584 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:32.598 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-09-28T00:23:31.109886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83496,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80000,"kb_avail":754891224,"statfs":{"total":773094113280,"available":773008613376,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81920000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003209"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707209+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:22:59.707209+0000","last_peered":"2023-09-28T00:22:59.707209+0000","last_clean":"2023-09-28T00:22:59.707209+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:22:59.707209+0000","last_undegraded":"2023-09-28T00:22:59.707209+0000","last_fullsized":"2023-09-28T00:22:59.707209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691348+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:23:00.691348+0000","last_peered":"2023-09-28T00:23:00.691348+0000","last_clean":"2023-09-28T00:23:00.691348+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:23:00.691348+0000","last_undegraded":"2023-09-28T00:23:00.691348+0000","last_fullsized":"2023-09-28T00:23:00.691348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188745+0000","last_change":"2023-09-28T00:22:59.705258+0000","last_active":"2023-09-28T00:23:02.188745+0000","last_peered":"2023-09-28T00:23:02.188745+0000","last_clean":"2023-09-28T00:23:02.188745+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:23:02.188745+0000","last_undegraded":"2023-09-28T00:23:02.188745+0000","last_fullsized":"2023-09-28T00:23:02.188745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188377+0000","last_change":"2023-09-28T00:22:59.710030+0000","last_active":"2023-09-28T00:23:02.188377+0000","last_peered":"2023-09-28T00:23:02.188377+0000","last_clean":"2023-09-28T00:23:02.188377+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:23:02.188377+0000","last_undegraded":"2023-09-28T00:23:02.188377+0000","last_fullsized":"2023-09-28T00:23:02.188377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710105+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:22:59.710105+0000","last_peered":"2023-09-28T00:22:59.710105+0000","last_clean":"2023-09-28T00:22:59.710105+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:22:59.710105+0000","last_undegraded":"2023-09-28T00:22:59.710105+0000","last_fullsized":"2023-09-28T00:22:59.710105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715438+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:22:59.715438+0000","last_peered":"2023-09-28T00:22:59.715438+0000","last_clean":"2023-09-28T00:22:59.715438+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:22:59.715438+0000","last_undegraded":"2023-09-28T00:22:59.715438+0000","last_fullsized":"2023-09-28T00:22:59.715438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:43.306783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.723978+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:22:59.723978+0000","last_peered":"2023-09-28T00:22:59.723978+0000","last_clean":"2023-09-28T00:22:59.723978+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:22:59.723978+0000","last_undegraded":"2023-09-28T00:22:59.723978+0000","last_fullsized":"2023-09-28T00:22:59.723978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:55:35.161857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546497+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:23:01.546497+0000","last_peered":"2023-09-28T00:23:01.546497+0000","last_clean":"2023-09-28T00:23:01.546497+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:23:01.546497+0000","last_undegraded":"2023-09-28T00:23:01.546497+0000","last_fullsized":"2023-09-28T00:23:01.546497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707409+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:22:59.707409+0000","last_peered":"2023-09-28T00:22:59.707409+0000","last_clean":"2023-09-28T00:22:59.707409+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:22:59.707409+0000","last_undegraded":"2023-09-28T00:22:59.707409+0000","last_fullsized":"2023-09-28T00:22:59.707409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546316+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:23:01.546316+0000","last_peered":"2023-09-28T00:23:01.546316+0000","last_clean":"2023-09-28T00:23:01.546316+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:23:01.546316+0000","last_undegraded":"2023-09-28T00:23:01.546316+0000","last_fullsized":"2023-09-28T00:23:01.546316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546471+0000","last_change":"2023-09-28T00:22:59.705340+0000","last_active":"2023-09-28T00:23:01.546471+0000","last_peered":"2023-09-28T00:23:01.546471+0000","last_clean":"2023-09-28T00:23:01.546471+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:23:01.546471+0000","last_undegraded":"2023-09-28T00:23:01.546471+0000","last_fullsized":"2023-09-28T00:23:01.546471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715440+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:22:59.715440+0000","last_peered":"2023-09-28T00:22:59.715440+0000","last_clean":"2023-09-28T00:22:59.715440+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:22:59.715440+0000","last_undegraded":"2023-09-28T00:22:59.715440+0000","last_fullsized":"2023-09-28T00:22:59.715440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:33.549102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703659+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:22:59.703659+0000","last_peered":"2023-09-28T00:22:59.703659+0000","last_clean":"2023-09-28T00:22:59.703659+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:22:59.703659+0000","last_undegraded":"2023-09-28T00:22:59.703659+0000","last_fullsized":"2023-09-28T00:22:59.703659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546087+0000","last_change":"2023-09-28T00:22:59.716095+0000","last_active":"2023-09-28T00:23:01.546087+0000","last_peered":"2023-09-28T00:23:01.546087+0000","last_clean":"2023-09-28T00:23:01.546087+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:23:01.546087+0000","last_undegraded":"2023-09-28T00:23:01.546087+0000","last_fullsized":"2023-09-28T00:23:01.546087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188289+0000","last_change":"2023-09-28T00:22:59.711725+0000","last_active":"2023-09-28T00:23:02.188289+0000","last_peered":"2023-09-28T00:23:02.188289+0000","last_clean":"2023-09-28T00:23:02.188289+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:23:02.188289+0000","last_undegraded":"2023-09-28T00:23:02.188289+0000","last_fullsized":"2023-09-28T00:23:02.188289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713655+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713655+0000","last_peered":"2023-09-28T00:22:59.713655+0000","last_clean":"2023-09-28T00:22:59.713655+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:22:59.713655+0000","last_undegraded":"2023-09-28T00:22:59.713655+0000","last_fullsized":"2023-09-28T00:22:59.713655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:25.800823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706543+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:22:59.706543+0000","last_peered":"2023-09-28T00:22:59.706543+0000","last_clean":"2023-09-28T00:22:59.706543+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:22:59.706543+0000","last_undegraded":"2023-09-28T00:22:59.706543+0000","last_fullsized":"2023-09-28T00:22:59.706543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188850+0000","last_change":"2023-09-28T00:22:59.706032+0000","last_active":"2023-09-28T00:23:02.188850+0000","last_peered":"2023-09-28T00:23:02.188850+0000","last_clean":"2023-09-28T00:23:02.188850+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:23:02.188850+0000","last_undegraded":"2023-09-28T00:23:02.188850+0000","last_fullsized":"2023-09-28T00:23:02.188850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715455+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:22:59.715455+0000","last_peered":"2023-09-28T00:22:59.715455+0000","last_clean":"2023-09-28T00:22:59.715455+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:22:59.715455+0000","last_undegraded":"2023-09-28T00:22:59.715455+0000","last_fullsized":"2023-09-28T00:22:59.715455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:38:38.440401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546158+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:23:01.546158+0000","last_peered":"2023-09-28T00:23:01.546158+0000","last_clean":"2023-09-28T00:23:01.546158+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:23:01.546158+0000","last_undegraded":"2023-09-28T00:23:01.546158+0000","last_fullsized":"2023-09-28T00:23:01.546158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546309+0000","last_change":"2023-09-28T00:22:59.716293+0000","last_active":"2023-09-28T00:23:01.546309+0000","last_peered":"2023-09-28T00:23:01.546309+0000","last_clean":"2023-09-28T00:23:01.546309+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:23:01.546309+0000","last_undegraded":"2023-09-28T00:23:01.546309+0000","last_fullsized":"2023-09-28T00:23:01.546309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.707144+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:22:59.707144+0000","last_peered":"2023-09-28T00:22:59.707144+0000","last_clean":"2023-09-28T00:22:59.707144+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:22:59.707144+0000","last_undegraded":"2023-09-28T00:22:59.707144+0000","last_fullsized":"2023-09-28T00:22:59.707144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:29.405225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704866+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:22:59.704866+0000","last_peered":"2023-09-28T00:22:59.704866+0000","last_clean":"2023-09-28T00:22:59.704866+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:22:59.704866+0000","last_undegraded":"2023-09-28T00:22:59.704866+0000","last_fullsized":"2023-09-28T00:22:59.704866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546426+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:23:01.546426+0000","last_peered":"2023-09-28T00:23:01.546426+0000","last_clean":"2023-09-28T00:23:01.546426+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:23:01.546426+0000","last_undegraded":"2023-09-28T00:23:01.546426+0000","last_fullsized":"2023-09-28T00:23:01.546426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719271+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:22:59.719271+0000","last_peered":"2023-09-28T00:22:59.719271+0000","last_clean":"2023-09-28T00:22:59.719271+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:22:59.719271+0000","last_undegraded":"2023-09-28T00:22:59.719271+0000","last_fullsized":"2023-09-28T00:22:59.719271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709143+0000","last_change":"2023-09-28T00:22:59.704017+0000","last_active":"2023-09-28T00:22:59.709143+0000","last_peered":"2023-09-28T00:22:59.709143+0000","last_clean":"2023-09-28T00:22:59.709143+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:22:59.709143+0000","last_undegraded":"2023-09-28T00:22:59.709143+0000","last_fullsized":"2023-09-28T00:22:59.709143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720061+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:22:59.720061+0000","last_peered":"2023-09-28T00:22:59.720061+0000","last_clean":"2023-09-28T00:22:59.720061+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:22:59.720061+0000","last_undegraded":"2023-09-28T00:22:59.720061+0000","last_fullsized":"2023-09-28T00:22:59.720061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:21:17.094614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722019+0000","last_change":"2023-09-28T00:22:59.203928+0000","last_active":"2023-09-28T00:23:04.722019+0000","last_peered":"2023-09-28T00:23:04.722019+0000","last_clean":"2023-09-28T00:23:04.722019+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:04.722019+0000","last_undegraded":"2023-09-28T00:23:04.722019+0000","last_fullsized":"2023-09-28T00:23:04.722019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704803+0000","last_change":"2023-09-28T00:22:59.702584+0000","last_active":"2023-09-28T00:22:59.704803+0000","last_peered":"2023-09-28T00:22:59.704803+0000","last_clean":"2023-09-28T00:22:59.704803+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:22:59.704803+0000","last_undegraded":"2023-09-28T00:22:59.704803+0000","last_fullsized":"2023-09-28T00:22:59.704803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.721198+0000","last_change":"2023-09-28T00:22:59.215439+0000","last_active":"2023-09-28T00:23:03.721198+0000","last_peered":"2023-09-28T00:23:03.721198+0000","last_clean":"2023-09-28T00:23:03.721198+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:03.721198+0000","last_undegraded":"2023-09-28T00:23:03.721198+0000","last_fullsized":"2023-09-28T00:23:03.721198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:04.631206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710999+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:22:59.710999+0000","last_peered":"2023-09-28T00:22:59.710999+0000","last_clean":"2023-09-28T00:22:59.710999+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:22:59.710999+0000","last_undegraded":"2023-09-28T00:22:59.710999+0000","last_fullsized":"2023-09-28T00:22:59.710999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:04:58.759880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.717925+0000","last_change":"2023-09-28T00:22:59.202775+0000","last_active":"2023-09-28T00:23:04.717925+0000","last_peered":"2023-09-28T00:23:04.717925+0000","last_clean":"2023-09-28T00:23:04.717925+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:04.717925+0000","last_undegraded":"2023-09-28T00:23:04.717925+0000","last_fullsized":"2023-09-28T00:23:04.717925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:09:29.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710593+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:22:59.710593+0000","last_peered":"2023-09-28T00:22:59.710593+0000","last_clean":"2023-09-28T00:22:59.710593+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:22:59.710593+0000","last_undegraded":"2023-09-28T00:22:59.710593+0000","last_fullsized":"2023-09-28T00:22:59.710593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:10.730020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.710025+0000","last_change":"2023-09-28T00:22:59.203121+0000","last_active":"2023-09-28T00:23:02.710025+0000","last_peered":"2023-09-28T00:23:02.710025+0000","last_clean":"2023-09-28T00:23:02.710025+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:02.710025+0000","last_undegraded":"2023-09-28T00:23:02.710025+0000","last_fullsized":"2023-09-28T00:23:02.710025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:10:35.411358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.715552+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:22:59.715552+0000","last_peered":"2023-09-28T00:22:59.715552+0000","last_clean":"2023-09-28T00:22:59.715552+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:22:59.715552+0000","last_undegraded":"2023-09-28T00:22:59.715552+0000","last_fullsized":"2023-09-28T00:22:59.715552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728366+0000","last_change":"2023-09-28T00:22:59.199574+0000","last_active":"2023-09-28T00:23:05.728366+0000","last_peered":"2023-09-28T00:23:05.728366+0000","last_clean":"2023-09-28T00:23:05.728366+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:05.728366+0000","last_undegraded":"2023-09-28T00:23:05.728366+0000","last_fullsized":"2023-09-28T00:23:05.728366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709760+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:22:59.709760+0000","last_peered":"2023-09-28T00:22:59.709760+0000","last_clean":"2023-09-28T00:22:59.709760+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:22:59.709760+0000","last_undegraded":"2023-09-28T00:22:59.709760+0000","last_fullsized":"2023-09-28T00:22:59.709760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:59:30.180095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'5","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718801+0000","last_change":"2023-09-28T00:22:59.217177+0000","last_active":"2023-09-28T00:23:04.718801+0000","last_peered":"2023-09-28T00:23:04.718801+0000","last_clean":"2023-09-28T00:23:04.718801+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:04.718801+0000","last_undegraded":"2023-09-28T00:23:04.718801+0000","last_fullsized":"2023-09-28T00:23:04.718801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.719469+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:22:59.719469+0000","last_peered":"2023-09-28T00:22:59.719469+0000","last_clean":"2023-09-28T00:22:59.719469+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:22:59.719469+0000","last_undegraded":"2023-09-28T00:22:59.719469+0000","last_fullsized":"2023-09-28T00:22:59.719469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728766+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728766+0000","last_peered":"2023-09-28T00:23:05.728766+0000","last_clean":"2023-09-28T00:23:05.728766+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728766+0000","last_undegraded":"2023-09-28T00:23:05.728766+0000","last_fullsized":"2023-09-28T00:23:05.728766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:15.096389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691264+0000","last_change":"2023-09-28T00:22:59.719585+0000","last_active":"2023-09-28T00:23:00.691264+0000","last_peered":"2023-09-28T00:23:00.691264+0000","last_clean":"2023-09-28T00:23:00.691264+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:23:00.691264+0000","last_undegraded":"2023-09-28T00:23:00.691264+0000","last_fullsized":"2023-09-28T00:23:00.691264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726359+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726359+0000","last_peered":"2023-09-28T00:23:05.726359+0000","last_clean":"2023-09-28T00:23:05.726359+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726359+0000","last_undegraded":"2023-09-28T00:23:05.726359+0000","last_fullsized":"2023-09-28T00:23:05.726359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:38.886909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703738+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:22:59.703738+0000","last_peered":"2023-09-28T00:22:59.703738+0000","last_clean":"2023-09-28T00:22:59.703738+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:22:59.703738+0000","last_undegraded":"2023-09-28T00:22:59.703738+0000","last_fullsized":"2023-09-28T00:22:59.703738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:37:35.853169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.720017+0000","last_change":"2023-09-28T00:22:59.204021+0000","last_active":"2023-09-28T00:23:04.720017+0000","last_peered":"2023-09-28T00:23:04.720017+0000","last_clean":"2023-09-28T00:23:04.720017+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:04.720017+0000","last_undegraded":"2023-09-28T00:23:04.720017+0000","last_fullsized":"2023-09-28T00:23:04.720017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.720040+0000","last_change":"2023-09-28T00:22:59.717032+0000","last_active":"2023-09-28T00:22:59.720040+0000","last_peered":"2023-09-28T00:22:59.720040+0000","last_clean":"2023-09-28T00:22:59.720040+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:22:59.720040+0000","last_undegraded":"2023-09-28T00:22:59.720040+0000","last_fullsized":"2023-09-28T00:22:59.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:38:56.775069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722483+0000","last_change":"2023-09-28T00:22:59.203675+0000","last_active":"2023-09-28T00:23:04.722483+0000","last_peered":"2023-09-28T00:23:04.722483+0000","last_clean":"2023-09-28T00:23:04.722483+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:04.722483+0000","last_undegraded":"2023-09-28T00:23:04.722483+0000","last_fullsized":"2023-09-28T00:23:04.722483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:51:16.338221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709607+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:22:59.709607+0000","last_peered":"2023-09-28T00:22:59.709607+0000","last_clean":"2023-09-28T00:22:59.709607+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:22:59.709607+0000","last_undegraded":"2023-09-28T00:22:59.709607+0000","last_fullsized":"2023-09-28T00:22:59.709607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:05:34.722415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'17","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722091+0000","last_change":"2023-09-28T00:22:59.210317+0000","last_active":"2023-09-28T00:23:05.722091+0000","last_peered":"2023-09-28T00:23:05.722091+0000","last_clean":"2023-09-28T00:23:05.722091+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:05.722091+0000","last_undegraded":"2023-09-28T00:23:05.722091+0000","last_fullsized":"2023-09-28T00:23:05.722091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710106+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:22:59.710106+0000","last_peered":"2023-09-28T00:22:59.710106+0000","last_clean":"2023-09-28T00:22:59.710106+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:22:59.710106+0000","last_undegraded":"2023-09-28T00:22:59.710106+0000","last_fullsized":"2023-09-28T00:22:59.710106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:10.583697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.319409+0000","last_change":"2023-09-28T00:23:29.319382+0000","last_active":"2023-09-28T00:23:29.319409+0000","last_peered":"2023-09-28T00:23:29.319409+0000","last_clean":"2023-09-28T00:23:29.319409+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:29.319409+0000","last_undegraded":"2023-09-28T00:23:29.319409+0000","last_fullsized":"2023-09-28T00:23:29.319409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.319298+0000","objects_scrubbed":2,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:16:37.432115+0000","scrub_duration":0.002326229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713674+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:22:59.713674+0000","last_peered":"2023-09-28T00:22:59.713674+0000","last_clean":"2023-09-28T00:22:59.713674+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:22:59.713674+0000","last_undegraded":"2023-09-28T00:22:59.713674+0000","last_fullsized":"2023-09-28T00:22:59.713674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:49:12.081646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728267+0000","last_change":"2023-09-28T00:22:59.215169+0000","last_active":"2023-09-28T00:23:05.728267+0000","last_peered":"2023-09-28T00:23:05.728267+0000","last_clean":"2023-09-28T00:23:05.728267+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:05.728267+0000","last_undegraded":"2023-09-28T00:23:05.728267+0000","last_fullsized":"2023-09-28T00:23:05.728267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546088+0000","last_change":"2023-09-28T00:22:59.714574+0000","last_active":"2023-09-28T00:23:01.546088+0000","last_peered":"2023-09-28T00:23:01.546088+0000","last_clean":"2023-09-28T00:23:01.546088+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:23:01.546088+0000","last_undegraded":"2023-09-28T00:23:01.546088+0000","last_fullsized":"2023-09-28T00:23:01.546088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.721507+0000","last_change":"2023-09-28T00:22:59.211942+0000","last_active":"2023-09-28T00:23:04.721507+0000","last_peered":"2023-09-28T00:23:04.721507+0000","last_clean":"2023-09-28T00:23:04.721507+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:04.721507+0000","last_undegraded":"2023-09-28T00:23:04.721507+0000","last_fullsized":"2023-09-28T00:23:04.721507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:55.584125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691137+0000","last_change":"2023-09-28T00:22:59.720227+0000","last_active":"2023-09-28T00:23:00.691137+0000","last_peered":"2023-09-28T00:23:00.691137+0000","last_clean":"2023-09-28T00:23:00.691137+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:23:00.691137+0000","last_undegraded":"2023-09-28T00:23:00.691137+0000","last_fullsized":"2023-09-28T00:23:00.691137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.723965+0000","last_change":"2023-09-28T00:22:59.217366+0000","last_active":"2023-09-28T00:23:04.723965+0000","last_peered":"2023-09-28T00:23:04.723965+0000","last_clean":"2023-09-28T00:23:04.723965+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:04.723965+0000","last_undegraded":"2023-09-28T00:23:04.723965+0000","last_fullsized":"2023-09-28T00:23:04.723965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701336+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:22:59.701336+0000","last_peered":"2023-09-28T00:22:59.701336+0000","last_clean":"2023-09-28T00:22:59.701336+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:22:59.701336+0000","last_undegraded":"2023-09-28T00:22:59.701336+0000","last_fullsized":"2023-09-28T00:22:59.701336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:37:16.101791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.708705+0000","last_change":"2023-09-28T00:22:59.203122+0000","last_active":"2023-09-28T00:23:02.708705+0000","last_peered":"2023-09-28T00:23:02.708705+0000","last_clean":"2023-09-28T00:23:02.708705+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:02.708705+0000","last_undegraded":"2023-09-28T00:23:02.708705+0000","last_fullsized":"2023-09-28T00:23:02.708705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:38.727004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188481+0000","last_change":"2023-09-28T00:22:59.710915+0000","last_active":"2023-09-28T00:23:02.188481+0000","last_peered":"2023-09-28T00:23:02.188481+0000","last_clean":"2023-09-28T00:23:02.188481+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:23:02.188481+0000","last_undegraded":"2023-09-28T00:23:02.188481+0000","last_fullsized":"2023-09-28T00:23:02.188481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'3","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.722580+0000","last_change":"2023-09-28T00:22:59.209147+0000","last_active":"2023-09-28T00:23:04.722580+0000","last_peered":"2023-09-28T00:23:04.722580+0000","last_clean":"2023-09-28T00:23:04.722580+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:04.722580+0000","last_undegraded":"2023-09-28T00:23:04.722580+0000","last_fullsized":"2023-09-28T00:23:04.722580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:50.087231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713987+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:22:59.713987+0000","last_peered":"2023-09-28T00:22:59.713987+0000","last_clean":"2023-09-28T00:22:59.713987+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:22:59.713987+0000","last_undegraded":"2023-09-28T00:22:59.713987+0000","last_fullsized":"2023-09-28T00:22:59.713987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:18:03.035102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725840+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725840+0000","last_peered":"2023-09-28T00:23:05.725840+0000","last_clean":"2023-09-28T00:23:05.725840+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725840+0000","last_undegraded":"2023-09-28T00:23:05.725840+0000","last_fullsized":"2023-09-28T00:23:05.725840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:43.057184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691356+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:23:00.691356+0000","last_peered":"2023-09-28T00:23:00.691356+0000","last_clean":"2023-09-28T00:23:00.691356+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:23:00.691356+0000","last_undegraded":"2023-09-28T00:23:00.691356+0000","last_fullsized":"2023-09-28T00:23:00.691356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.707789+0000","last_change":"2023-09-28T00:22:59.205457+0000","last_active":"2023-09-28T00:23:02.707789+0000","last_peered":"2023-09-28T00:23:02.707789+0000","last_clean":"2023-09-28T00:23:02.707789+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:02.707789+0000","last_undegraded":"2023-09-28T00:23:02.707789+0000","last_fullsized":"2023-09-28T00:23:02.707789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.701432+0000","last_change":"2023-09-28T00:22:59.700393+0000","last_active":"2023-09-28T00:22:59.701432+0000","last_peered":"2023-09-28T00:22:59.701432+0000","last_clean":"2023-09-28T00:22:59.701432+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:22:59.701432+0000","last_undegraded":"2023-09-28T00:22:59.701432+0000","last_fullsized":"2023-09-28T00:22:59.701432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.691908+0000","last_change":"2023-09-28T00:22:54.431336+0000","last_active":"2023-09-28T00:22:59.691908+0000","last_peered":"2023-09-28T00:22:59.691908+0000","last_clean":"2023-09-28T00:22:59.691908+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:22:59.691908+0000","last_undegraded":"2023-09-28T00:22:59.691908+0000","last_fullsized":"2023-09-28T00:22:59.691908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:41.299266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.350385+0000","last_change":"2023-09-28T00:23:29.350352+0000","last_active":"2023-09-28T00:23:29.350385+0000","last_peered":"2023-09-28T00:23:29.350385+0000","last_clean":"2023-09-28T00:23:29.350385+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:29.350385+0000","last_undegraded":"2023-09-28T00:23:29.350385+0000","last_fullsized":"2023-09-28T00:23:29.350385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.350273+0000","objects_scrubbed":3,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:06:24.282255+0000","scrub_duration":0.0024491669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.712458+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:22:59.712458+0000","last_peered":"2023-09-28T00:22:59.712458+0000","last_clean":"2023-09-28T00:22:59.712458+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:22:59.712458+0000","last_undegraded":"2023-09-28T00:22:59.712458+0000","last_fullsized":"2023-09-28T00:22:59.712458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:36:39.892312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690417+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:22:59.690417+0000","last_peered":"2023-09-28T00:22:59.690417+0000","last_clean":"2023-09-28T00:22:59.690417+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:22:59.690417+0000","last_undegraded":"2023-09-28T00:22:59.690417+0000","last_fullsized":"2023-09-28T00:22:59.690417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:35.664332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728812+0000","last_change":"2023-09-28T00:22:59.212270+0000","last_active":"2023-09-28T00:23:05.728812+0000","last_peered":"2023-09-28T00:23:05.728812+0000","last_clean":"2023-09-28T00:23:05.728812+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:05.728812+0000","last_undegraded":"2023-09-28T00:23:05.728812+0000","last_fullsized":"2023-09-28T00:23:05.728812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703718+0000","last_change":"2023-09-28T00:22:59.696312+0000","last_active":"2023-09-28T00:22:59.703718+0000","last_peered":"2023-09-28T00:22:59.703718+0000","last_clean":"2023-09-28T00:22:59.703718+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:22:59.703718+0000","last_undegraded":"2023-09-28T00:22:59.703718+0000","last_fullsized":"2023-09-28T00:22:59.703718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:55.381056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.692742+0000","last_change":"2023-09-28T00:22:54.171050+0000","last_active":"2023-09-28T00:22:59.692742+0000","last_peered":"2023-09-28T00:22:59.692742+0000","last_clean":"2023-09-28T00:22:59.692742+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:22:59.692742+0000","last_undegraded":"2023-09-28T00:22:59.692742+0000","last_fullsized":"2023-09-28T00:22:59.692742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719030+0000","last_change":"2023-09-28T00:22:59.202342+0000","last_active":"2023-09-28T00:23:03.719030+0000","last_peered":"2023-09-28T00:23:03.719030+0000","last_clean":"2023-09-28T00:23:03.719030+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:03.719030+0000","last_undegraded":"2023-09-28T00:23:03.719030+0000","last_fullsized":"2023-09-28T00:23:03.719030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704695+0000","last_change":"2023-09-28T00:22:59.701256+0000","last_active":"2023-09-28T00:22:59.704695+0000","last_peered":"2023-09-28T00:22:59.704695+0000","last_clean":"2023-09-28T00:22:59.704695+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:22:59.704695+0000","last_undegraded":"2023-09-28T00:22:59.704695+0000","last_fullsized":"2023-09-28T00:22:59.704695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:26:56.589527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.689321+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:22:59.689321+0000","last_peered":"2023-09-28T00:22:59.689321+0000","last_clean":"2023-09-28T00:22:59.689321+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:22:59.689321+0000","last_undegraded":"2023-09-28T00:22:59.689321+0000","last_fullsized":"2023-09-28T00:22:59.689321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:43:44.894021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546175+0000","last_change":"2023-09-28T00:22:46.819119+0000","last_active":"2023-09-28T00:23:01.546175+0000","last_peered":"2023-09-28T00:23:01.546175+0000","last_clean":"2023-09-28T00:23:01.546175+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:23:01.546175+0000","last_undegraded":"2023-09-28T00:23:01.546175+0000","last_fullsized":"2023-09-28T00:23:01.546175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:45.805540+0000","last_clean_scrub_stamp":"2023-09-28T00:22:45.805540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728787+0000","last_change":"2023-09-28T00:22:59.205956+0000","last_active":"2023-09-28T00:23:05.728787+0000","last_peered":"2023-09-28T00:23:05.728787+0000","last_clean":"2023-09-28T00:23:05.728787+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:05.728787+0000","last_undegraded":"2023-09-28T00:23:05.728787+0000","last_fullsized":"2023-09-28T00:23:05.728787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.713969+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:22:59.713969+0000","last_peered":"2023-09-28T00:22:59.713969+0000","last_clean":"2023-09-28T00:22:59.713969+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:22:59.713969+0000","last_undegraded":"2023-09-28T00:22:59.713969+0000","last_fullsized":"2023-09-28T00:22:59.713969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:26:42.471132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.688375+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:22:59.688375+0000","last_peered":"2023-09-28T00:22:59.688375+0000","last_clean":"2023-09-28T00:22:59.688375+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:22:59.688375+0000","last_undegraded":"2023-09-28T00:22:59.688375+0000","last_fullsized":"2023-09-28T00:22:59.688375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:21:47.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:03.719836+0000","last_change":"2023-09-28T00:22:59.207673+0000","last_active":"2023-09-28T00:23:03.719836+0000","last_peered":"2023-09-28T00:23:03.719836+0000","last_clean":"2023-09-28T00:23:03.719836+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:03.719836+0000","last_undegraded":"2023-09-28T00:23:03.719836+0000","last_fullsized":"2023-09-28T00:23:03.719836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:48:25.218023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703223+0000","last_change":"2023-09-28T00:22:59.700976+0000","last_active":"2023-09-28T00:22:59.703223+0000","last_peered":"2023-09-28T00:22:59.703223+0000","last_clean":"2023-09-28T00:22:59.703223+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:22:59.703223+0000","last_undegraded":"2023-09-28T00:22:59.703223+0000","last_fullsized":"2023-09-28T00:22:59.703223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:28.073712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.690163+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:22:59.690163+0000","last_peered":"2023-09-28T00:22:59.690163+0000","last_clean":"2023-09-28T00:22:59.690163+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:22:59.690163+0000","last_undegraded":"2023-09-28T00:22:59.690163+0000","last_fullsized":"2023-09-28T00:22:59.690163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:19:41.330510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189439+0000","last_change":"2023-09-28T00:22:59.201383+0000","last_active":"2023-09-28T00:23:02.189439+0000","last_peered":"2023-09-28T00:23:02.189439+0000","last_clean":"2023-09-28T00:23:02.189439+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:02.189439+0000","last_undegraded":"2023-09-28T00:23:02.189439+0000","last_fullsized":"2023-09-28T00:23:02.189439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:52.774081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.704772+0000","last_change":"2023-09-28T00:22:59.702200+0000","last_active":"2023-09-28T00:22:59.704772+0000","last_peered":"2023-09-28T00:22:59.704772+0000","last_clean":"2023-09-28T00:22:59.704772+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:22:59.704772+0000","last_undegraded":"2023-09-28T00:22:59.704772+0000","last_fullsized":"2023-09-28T00:22:59.704772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:19:44.062587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.722475+0000","last_change":"2023-09-28T00:22:59.204000+0000","last_active":"2023-09-28T00:23:05.722475+0000","last_peered":"2023-09-28T00:23:05.722475+0000","last_clean":"2023-09-28T00:23:05.722475+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:05.722475+0000","last_undegraded":"2023-09-28T00:23:05.722475+0000","last_fullsized":"2023-09-28T00:23:05.722475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:04:26.951922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.697660+0000","last_change":"2023-09-28T00:22:54.171333+0000","last_active":"2023-09-28T00:22:59.697660+0000","last_peered":"2023-09-28T00:22:59.697660+0000","last_clean":"2023-09-28T00:22:59.697660+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:22:59.697660+0000","last_undegraded":"2023-09-28T00:22:59.697660+0000","last_fullsized":"2023-09-28T00:22:59.697660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:53.006948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.722432+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:22:59.722432+0000","last_peered":"2023-09-28T00:22:59.722432+0000","last_clean":"2023-09-28T00:22:59.722432+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:22:59.722432+0000","last_undegraded":"2023-09-28T00:22:59.722432+0000","last_fullsized":"2023-09-28T00:22:59.722432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:23.982049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.687994+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:22:59.687994+0000","last_peered":"2023-09-28T00:22:59.687994+0000","last_clean":"2023-09-28T00:22:59.687994+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:22:59.687994+0000","last_undegraded":"2023-09-28T00:22:59.687994+0000","last_fullsized":"2023-09-28T00:22:59.687994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:03:47.751329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:04.718240+0000","last_change":"2023-09-28T00:22:59.205409+0000","last_active":"2023-09-28T00:23:04.718240+0000","last_peered":"2023-09-28T00:23:04.718240+0000","last_clean":"2023-09-28T00:23:04.718240+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:04.718240+0000","last_undegraded":"2023-09-28T00:23:04.718240+0000","last_fullsized":"2023-09-28T00:23:04.718240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:55:03.190048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691067+0000","last_change":"2023-09-28T00:22:59.719323+0000","last_active":"2023-09-28T00:23:00.691067+0000","last_peered":"2023-09-28T00:23:00.691067+0000","last_clean":"2023-09-28T00:23:00.691067+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:23:00.691067+0000","last_undegraded":"2023-09-28T00:23:00.691067+0000","last_fullsized":"2023-09-28T00:23:00.691067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'5","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.709017+0000","last_change":"2023-09-28T00:22:59.218045+0000","last_active":"2023-09-28T00:23:02.709017+0000","last_peered":"2023-09-28T00:23:02.709017+0000","last_clean":"2023-09-28T00:23:02.709017+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:02.709017+0000","last_undegraded":"2023-09-28T00:23:02.709017+0000","last_fullsized":"2023-09-28T00:23:02.709017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:46:54.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.708847+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:22:59.708847+0000","last_peered":"2023-09-28T00:22:59.708847+0000","last_clean":"2023-09-28T00:22:59.708847+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:22:59.708847+0000","last_undegraded":"2023-09-28T00:22:59.708847+0000","last_fullsized":"2023-09-28T00:22:59.708847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:45:15.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'5","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726406+0000","last_change":"2023-09-28T00:22:59.221462+0000","last_active":"2023-09-28T00:23:05.726406+0000","last_peered":"2023-09-28T00:23:05.726406+0000","last_clean":"2023-09-28T00:23:05.726406+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:05.726406+0000","last_undegraded":"2023-09-28T00:23:05.726406+0000","last_fullsized":"2023-09-28T00:23:05.726406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691213+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:23:00.691213+0000","last_peered":"2023-09-28T00:23:00.691213+0000","last_clean":"2023-09-28T00:23:00.691213+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:23:00.691213+0000","last_undegraded":"2023-09-28T00:23:00.691213+0000","last_fullsized":"2023-09-28T00:23:00.691213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'12","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.727227+0000","last_change":"2023-09-28T00:22:59.218182+0000","last_active":"2023-09-28T00:23:05.727227+0000","last_peered":"2023-09-28T00:23:05.727227+0000","last_clean":"2023-09-28T00:23:05.727227+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:05.727227+0000","last_undegraded":"2023-09-28T00:23:05.727227+0000","last_fullsized":"2023-09-28T00:23:05.727227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:53:51.202173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691101+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:23:00.691101+0000","last_peered":"2023-09-28T00:23:00.691101+0000","last_clean":"2023-09-28T00:23:00.691101+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:23:00.691101+0000","last_undegraded":"2023-09-28T00:23:00.691101+0000","last_fullsized":"2023-09-28T00:23:00.691101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691788+0000","last_change":"2023-09-28T00:22:59.201046+0000","last_active":"2023-09-28T00:23:00.691788+0000","last_peered":"2023-09-28T00:23:00.691788+0000","last_clean":"2023-09-28T00:23:00.691788+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:00.691788+0000","last_undegraded":"2023-09-28T00:23:00.691788+0000","last_fullsized":"2023-09-28T00:23:00.691788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:43:51.917066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.703016+0000","last_change":"2023-09-28T00:22:59.701566+0000","last_active":"2023-09-28T00:22:59.703016+0000","last_peered":"2023-09-28T00:22:59.703016+0000","last_clean":"2023-09-28T00:22:59.703016+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:22:59.703016+0000","last_undegraded":"2023-09-28T00:22:59.703016+0000","last_fullsized":"2023-09-28T00:22:59.703016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:21:05.636608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'13","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725695+0000","last_change":"2023-09-28T00:22:59.207519+0000","last_active":"2023-09-28T00:23:05.725695+0000","last_peered":"2023-09-28T00:23:05.725695+0000","last_clean":"2023-09-28T00:23:05.725695+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:05.725695+0000","last_undegraded":"2023-09-28T00:23:05.725695+0000","last_fullsized":"2023-09-28T00:23:05.725695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:51:50.867804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.690992+0000","last_change":"2023-09-28T00:22:59.709112+0000","last_active":"2023-09-28T00:23:00.690992+0000","last_peered":"2023-09-28T00:23:00.690992+0000","last_clean":"2023-09-28T00:23:00.690992+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:23:00.690992+0000","last_undegraded":"2023-09-28T00:23:00.690992+0000","last_fullsized":"2023-09-28T00:23:00.690992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546370+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:23:01.546370+0000","last_peered":"2023-09-28T00:23:01.546370+0000","last_clean":"2023-09-28T00:23:01.546370+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:23:01.546370+0000","last_undegraded":"2023-09-28T00:23:01.546370+0000","last_fullsized":"2023-09-28T00:23:01.546370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.706312+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:22:59.706312+0000","last_peered":"2023-09-28T00:22:59.706312+0000","last_clean":"2023-09-28T00:22:59.706312+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:22:59.706312+0000","last_undegraded":"2023-09-28T00:22:59.706312+0000","last_fullsized":"2023-09-28T00:22:59.706312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:16:51.092634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188379+0000","last_change":"2023-09-28T00:22:59.723520+0000","last_active":"2023-09-28T00:23:02.188379+0000","last_peered":"2023-09-28T00:23:02.188379+0000","last_clean":"2023-09-28T00:23:02.188379+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:23:02.188379+0000","last_undegraded":"2023-09-28T00:23:02.188379+0000","last_fullsized":"2023-09-28T00:23:02.188379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.710523+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:22:59.710523+0000","last_peered":"2023-09-28T00:22:59.710523+0000","last_clean":"2023-09-28T00:22:59.710523+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:22:59.710523+0000","last_undegraded":"2023-09-28T00:22:59.710523+0000","last_fullsized":"2023-09-28T00:22:59.710523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:29.385067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:22:59.709663+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:22:59.709663+0000","last_peered":"2023-09-28T00:22:59.709663+0000","last_clean":"2023-09-28T00:22:59.709663+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:22:59.709663+0000","last_undegraded":"2023-09-28T00:22:59.709663+0000","last_fullsized":"2023-09-28T00:22:59.709663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:40.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13284,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358556,"statfs":{"total":96636764160,"available":96623161344,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8088,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363752,"statfs":{"total":96636764160,"available":96628482048,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:32.610 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.610 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.610 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.610 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.611 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.611 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.611 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.611 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.611 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.612 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.612 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.612 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.612 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.612 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.613 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.613 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.613 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.613 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.614 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.614 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.614 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.614 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.614 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.615 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.615 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.615 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.615 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.615 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.616 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.616 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.616 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.616 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.616 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.617 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.617 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.617 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.617 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.617 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.618 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.618 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.618 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.618 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.618 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.619 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.619 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.619 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.619 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.619 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.620 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.620 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.620 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.620 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.620 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.621 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.621 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.621 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.621 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.621 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.622 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.622 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.622 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.622 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.623 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.623 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.623 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.623 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.623 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.624 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.624 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.624 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.624 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.624 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.625 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.625 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T00:22:45.805540+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=45, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.625 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.625 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.625 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.626 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.626 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.626 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.626 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.627 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.627 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.627 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.627 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.627 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.628 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.628 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.628 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.628 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.628 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.629 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.629 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.629 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.629 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.629 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.630 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.630 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.630 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.630 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.630 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.631 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.631 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:32.631 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:23:52.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:23:52.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.832+0000 7f569bfff700 1 Processor -- start 2023-09-28T00:23:52.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.833+0000 7f569bfff700 1 -- start start 2023-09-28T00:23:52.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569bfff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f569c068990 0x7f569c068d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:52.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569bfff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c1557c0 con 0x7f569c0c71f0 2023-09-28T00:23:52.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569bfff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c06c7d0 con 0x7f569c06cc60 2023-09-28T00:23:52.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569bfff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0692a0 con 0x7f569c068990 2023-09-28T00:23:52.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569affd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f569c068990 0x7f569c068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:52.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569b7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f569c0c71f0 0x7f569c0c2fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42348/0 (socket says 172.21.15.53:42348) 2023-09-28T00:23:52.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569b7fe700 1 -- 172.21.15.53:0/767834240 learned_addr learned my addr 172.21.15.53:0/767834240 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:23:52.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569affd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f569c068990 0x7f569c068d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44408/0 (socket says 172.21.15.53:44408) 2023-09-28T00:23:52.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569affd700 1 -- 172.21.15.53:0/767834240 >> v1:172.21.15.118:6789/0 conn(0x7f569c06cc60 legacy=0x7f569c1568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:52.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569affd700 1 -- 172.21.15.53:0/767834240 >> v1:172.21.15.53:6789/0 conn(0x7f569c0c71f0 legacy=0x7f569c0c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f569affd700 1 -- 172.21.15.53:0/767834240 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0635f0 con 0x7f569c068990 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.834+0000 7f5699ffb700 1 -- 172.21.15.53:0/767834240 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032406570 0 0) 0x7f569c1557c0 con 0x7f569c0c71f0 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.835+0000 7f569affd700 1 --2- 172.21.15.53:0/767834240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c068d60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f568c009910 tx=0x7f568c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd9b0af7a5a46ec server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.835+0000 7f5699ffb700 1 -- 172.21.15.53:0/767834240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00b820 con 0x7f569c068990 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.835+0000 7f5699ffb700 1 -- 172.21.15.53:0/767834240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c00b980 con 0x7f569c068990 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.835+0000 7f5699ffb700 1 -- 172.21.15.53:0/767834240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00bd20 con 0x7f569c068990 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.835+0000 7f569bfff700 1 -- 172.21.15.53:0/767834240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 msgr2=0x7f569c068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:52.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.835+0000 7f569bfff700 1 --2- 172.21.15.53:0/767834240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c068d60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f568c009910 tx=0x7f568c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:23:52.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.836+0000 7f569bfff700 1 -- 172.21.15.53:0/767834240 shutdown_connections 2023-09-28T00:23:52.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.836+0000 7f569bfff700 1 --2- 172.21.15.53:0/767834240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c068d60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:52.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.836+0000 7f569bfff700 1 -- 172.21.15.53:0/767834240 >> 172.21.15.53:0/767834240 conn(0x7f569c067630 msgr2=0x7f569c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:52.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.836+0000 7f569bfff700 1 -- 172.21.15.53:0/767834240 shutdown_connections 2023-09-28T00:23:52.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.836+0000 7f569bfff700 1 -- 172.21.15.53:0/767834240 wait complete. 2023-09-28T00:23:52.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.837+0000 7f569bfff700 1 Processor -- start 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.837+0000 7f569bfff700 1 -- start start 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c165b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569c06cc60 0x7f569c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569c0c71f0 0x7f569c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569bfff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c165180 con 0x7f569c068990 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569bfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c169600 con 0x7f569c06cc60 2023-09-28T00:23:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569bfff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1660d0 con 0x7f569c0c71f0 2023-09-28T00:23:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c165b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44420/0 (socket says 172.21.15.53:44420) 2023-09-28T00:23:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569affd700 1 -- 172.21.15.53:0/3332836966 learned_addr learned my addr 172.21.15.53:0/3332836966 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:23:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.838+0000 7f569a7fc700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569c06cc60 0x7f569c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569b7fe700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569c0c71f0 0x7f569c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569affd700 1 -- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569c0c71f0 msgr2=0x7f569c15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569affd700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569c0c71f0 0x7f569c15afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569affd700 1 -- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569c06cc60 msgr2=0x7f569c147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569affd700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569c06cc60 0x7f569c147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569affd700 1 -- 172.21.15.53:0/3332836966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c009420 con 0x7f569c068990 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569affd700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c165b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f569c06f290 tx=0x7f568c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c01f070 con 0x7f569c068990 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c002f70 con 0x7f569c068990 2023-09-28T00:23:52.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00bd20 con 0x7f569c068990 2023-09-28T00:23:52.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.839+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c165700 con 0x7f569c068990 2023-09-28T00:23:52.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.840+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c14a790 con 0x7f569c068990 2023-09-28T00:23:52.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.840+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c1659e0 con 0x7f569c068990 2023-09-28T00:23:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.841+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f568c023070 con 0x7f569c068990 2023-09-28T00:23:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.842+0000 7f5682ffd700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5688067330 0x7f56880697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:23:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.843+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f568c086170 con 0x7f569c068990 2023-09-28T00:23:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.843+0000 7f569a7fc700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5688067330 0x7f56880697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:23:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.844+0000 7f569a7fc700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5688067330 0x7f56880697e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f569c06c160 tx=0x7f5690007ec0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:23:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:52.846+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f568c052fd0 con 0x7f569c068990 2023-09-28T00:23:53.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.042+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f569c04c3c0 con 0x7f5688067330 2023-09-28T00:23:53.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.051+0000 7f5682ffd700 1 -- 172.21.15.53:0/3332836966 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308266 (secure 0 0 0) 0x7f569c04c3c0 con 0x7f5688067330 2023-09-28T00:23:53.055 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:23:53.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5688067330 msgr2=0x7f56880697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:53.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5688067330 0x7f56880697e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f569c06c160 tx=0x7f5690007ec0 comp rx=0 tx=0).stop 2023-09-28T00:23:53.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 msgr2=0x7f569c165b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c165b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f569c06f290 tx=0x7f568c017000 comp rx=0 tx=0).stop 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 shutdown_connections 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f5688067330 0x7f56880697e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569c0c71f0 0x7f569c15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f569c068990 0x7f569c165b90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 --2- 172.21.15.53:0/3332836966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569c06cc60 0x7f569c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:23:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 >> 172.21.15.53:0/3332836966 conn(0x7f569c067630 msgr2=0x7f569c0c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:23:53.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 shutdown_connections 2023-09-28T00:23:53.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:23:53.056+0000 7f569bfff700 1 -- 172.21.15.53:0/3332836966 wait complete. 2023-09-28T00:23:53.060 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:23:53.073 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-09-28T00:23:51.115557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19520,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83688,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80192,"kb_avail":754891032,"statfs":{"total":773094113280,"available":773008416768,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82116608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003342"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691855+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:23:00.691855+0000","last_peered":"2023-09-28T00:23:00.691855+0000","last_clean":"2023-09-28T00:23:00.691855+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:23:00.691855+0000","last_undegraded":"2023-09-28T00:23:00.691855+0000","last_fullsized":"2023-09-28T00:23:00.691855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691348+0000","last_change":"2023-09-28T00:22:59.708075+0000","last_active":"2023-09-28T00:23:00.691348+0000","last_peered":"2023-09-28T00:23:00.691348+0000","last_clean":"2023-09-28T00:23:00.691348+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:23:00.691348+0000","last_undegraded":"2023-09-28T00:23:00.691348+0000","last_fullsized":"2023-09-28T00:23:00.691348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.092457+0000","last_change":"2023-09-28T00:23:44.092424+0000","last_active":"2023-09-28T00:23:44.092457+0000","last_peered":"2023-09-28T00:23:44.092457+0000","last_clean":"2023-09-28T00:23:44.092457+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:23:44.092457+0000","last_undegraded":"2023-09-28T00:23:44.092457+0000","last_fullsized":"2023-09-28T00:23:44.092457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.092327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:23.376972+0000","scrub_duration":0.002012476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.097707+0000","last_change":"2023-09-28T00:23:43.097674+0000","last_active":"2023-09-28T00:23:43.097707+0000","last_peered":"2023-09-28T00:23:43.097707+0000","last_clean":"2023-09-28T00:23:43.097707+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:23:43.097707+0000","last_undegraded":"2023-09-28T00:23:43.097707+0000","last_fullsized":"2023-09-28T00:23:43.097707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.097578+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:25.670621+0000","scrub_duration":0.0022080009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188880+0000","last_change":"2023-09-28T00:22:59.709271+0000","last_active":"2023-09-28T00:23:02.188880+0000","last_peered":"2023-09-28T00:23:02.188880+0000","last_clean":"2023-09-28T00:23:02.188880+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:23:02.188880+0000","last_undegraded":"2023-09-28T00:23:02.188880+0000","last_fullsized":"2023-09-28T00:23:02.188880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188867+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:23:02.188867+0000","last_peered":"2023-09-28T00:23:02.188867+0000","last_clean":"2023-09-28T00:23:02.188867+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:23:02.188867+0000","last_undegraded":"2023-09-28T00:23:02.188867+0000","last_fullsized":"2023-09-28T00:23:02.188867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188459+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:23:02.188459+0000","last_peered":"2023-09-28T00:23:02.188459+0000","last_clean":"2023-09-28T00:23:02.188459+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:23:02.188459+0000","last_undegraded":"2023-09-28T00:23:02.188459+0000","last_fullsized":"2023-09-28T00:23:02.188459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546497+0000","last_change":"2023-09-28T00:22:59.702306+0000","last_active":"2023-09-28T00:23:01.546497+0000","last_peered":"2023-09-28T00:23:01.546497+0000","last_clean":"2023-09-28T00:23:01.546497+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:23:01.546497+0000","last_undegraded":"2023-09-28T00:23:01.546497+0000","last_fullsized":"2023-09-28T00:23:01.546497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189192+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:23:02.189192+0000","last_peered":"2023-09-28T00:23:02.189192+0000","last_clean":"2023-09-28T00:23:02.189192+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:23:02.189192+0000","last_undegraded":"2023-09-28T00:23:02.189192+0000","last_fullsized":"2023-09-28T00:23:02.189192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546316+0000","last_change":"2023-09-28T00:22:59.693696+0000","last_active":"2023-09-28T00:23:01.546316+0000","last_peered":"2023-09-28T00:23:01.546316+0000","last_clean":"2023-09-28T00:23:01.546316+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:23:01.546316+0000","last_undegraded":"2023-09-28T00:23:01.546316+0000","last_fullsized":"2023-09-28T00:23:01.546316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.529212+0000","last_change":"2023-09-28T00:23:44.529175+0000","last_active":"2023-09-28T00:23:44.529212+0000","last_peered":"2023-09-28T00:23:44.529212+0000","last_clean":"2023-09-28T00:23:44.529212+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:23:44.529212+0000","last_undegraded":"2023-09-28T00:23:44.529212+0000","last_fullsized":"2023-09-28T00:23:44.529212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.529073+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:43.148019+0000","scrub_duration":0.001863382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.692055+0000","last_change":"2023-09-28T00:22:59.714746+0000","last_active":"2023-09-28T00:23:00.692055+0000","last_peered":"2023-09-28T00:23:00.692055+0000","last_clean":"2023-09-28T00:23:00.692055+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:23:00.692055+0000","last_undegraded":"2023-09-28T00:23:00.692055+0000","last_fullsized":"2023-09-28T00:23:00.692055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188908+0000","last_change":"2023-09-28T00:22:59.698700+0000","last_active":"2023-09-28T00:23:02.188908+0000","last_peered":"2023-09-28T00:23:02.188908+0000","last_clean":"2023-09-28T00:23:02.188908+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:23:02.188908+0000","last_undegraded":"2023-09-28T00:23:02.188908+0000","last_fullsized":"2023-09-28T00:23:02.188908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.544101+0000","last_change":"2023-09-28T00:23:39.544046+0000","last_active":"2023-09-28T00:23:39.544101+0000","last_peered":"2023-09-28T00:23:39.544101+0000","last_clean":"2023-09-28T00:23:39.544101+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:23:39.544101+0000","last_undegraded":"2023-09-28T00:23:39.544101+0000","last_fullsized":"2023-09-28T00:23:39.544101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.543902+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:35.374173+0000","scrub_duration":0.0021413439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.235617+0000","last_change":"2023-09-28T00:23:36.235585+0000","last_active":"2023-09-28T00:23:36.235617+0000","last_peered":"2023-09-28T00:23:36.235617+0000","last_clean":"2023-09-28T00:23:36.235617+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:23:36.235617+0000","last_undegraded":"2023-09-28T00:23:36.235617+0000","last_fullsized":"2023-09-28T00:23:36.235617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.235489+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:27.658919+0000","scrub_duration":0.0021098010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188346+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:23:02.188346+0000","last_peered":"2023-09-28T00:23:02.188346+0000","last_clean":"2023-09-28T00:23:02.188346+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:23:02.188346+0000","last_undegraded":"2023-09-28T00:23:02.188346+0000","last_fullsized":"2023-09-28T00:23:02.188346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189971+0000","last_change":"2023-09-28T00:22:59.702980+0000","last_active":"2023-09-28T00:23:02.189971+0000","last_peered":"2023-09-28T00:23:02.189971+0000","last_clean":"2023-09-28T00:23:02.189971+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:23:02.189971+0000","last_undegraded":"2023-09-28T00:23:02.189971+0000","last_fullsized":"2023-09-28T00:23:02.189971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:41.178631+0000","last_change":"2023-09-28T00:23:41.178598+0000","last_active":"2023-09-28T00:23:41.178631+0000","last_peered":"2023-09-28T00:23:41.178631+0000","last_clean":"2023-09-28T00:23:41.178631+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:23:41.178631+0000","last_undegraded":"2023-09-28T00:23:41.178631+0000","last_fullsized":"2023-09-28T00:23:41.178631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_clean_scrub_stamp":"2023-09-28T00:23:41.178477+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:43.631297+0000","scrub_duration":0.0018761540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691924+0000","last_change":"2023-09-28T00:22:59.714789+0000","last_active":"2023-09-28T00:23:00.691924+0000","last_peered":"2023-09-28T00:23:00.691924+0000","last_clean":"2023-09-28T00:23:00.691924+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:23:00.691924+0000","last_undegraded":"2023-09-28T00:23:00.691924+0000","last_fullsized":"2023-09-28T00:23:00.691924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546158+0000","last_change":"2023-09-28T00:22:59.703608+0000","last_active":"2023-09-28T00:23:01.546158+0000","last_peered":"2023-09-28T00:23:01.546158+0000","last_clean":"2023-09-28T00:23:01.546158+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:23:01.546158+0000","last_undegraded":"2023-09-28T00:23:01.546158+0000","last_fullsized":"2023-09-28T00:23:01.546158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.500911+0000","last_change":"2023-09-28T00:23:40.500873+0000","last_active":"2023-09-28T00:23:40.500911+0000","last_peered":"2023-09-28T00:23:40.500911+0000","last_clean":"2023-09-28T00:23:40.500911+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:23:40.500911+0000","last_undegraded":"2023-09-28T00:23:40.500911+0000","last_fullsized":"2023-09-28T00:23:40.500911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.500773+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:13.242345+0000","scrub_duration":0.00202352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.190043+0000","last_change":"2023-09-28T00:22:59.703719+0000","last_active":"2023-09-28T00:23:02.190043+0000","last_peered":"2023-09-28T00:23:02.190043+0000","last_clean":"2023-09-28T00:23:02.190043+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:23:02.190043+0000","last_undegraded":"2023-09-28T00:23:02.190043+0000","last_fullsized":"2023-09-28T00:23:02.190043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189638+0000","last_change":"2023-09-28T00:22:59.702412+0000","last_active":"2023-09-28T00:23:02.189638+0000","last_peered":"2023-09-28T00:23:02.189638+0000","last_clean":"2023-09-28T00:23:02.189638+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:23:02.189638+0000","last_undegraded":"2023-09-28T00:23:02.189638+0000","last_fullsized":"2023-09-28T00:23:02.189638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546426+0000","last_change":"2023-09-28T00:22:59.706728+0000","last_active":"2023-09-28T00:23:01.546426+0000","last_peered":"2023-09-28T00:23:01.546426+0000","last_clean":"2023-09-28T00:23:01.546426+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:23:01.546426+0000","last_undegraded":"2023-09-28T00:23:01.546426+0000","last_fullsized":"2023-09-28T00:23:01.546426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189436+0000","last_change":"2023-09-28T00:22:59.718869+0000","last_active":"2023-09-28T00:23:02.189436+0000","last_peered":"2023-09-28T00:23:02.189436+0000","last_clean":"2023-09-28T00:23:02.189436+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:23:02.189436+0000","last_undegraded":"2023-09-28T00:23:02.189436+0000","last_fullsized":"2023-09-28T00:23:02.189436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.945781+0000","last_change":"2023-09-28T00:23:45.945752+0000","last_active":"2023-09-28T00:23:45.945781+0000","last_peered":"2023-09-28T00:23:45.945781+0000","last_clean":"2023-09-28T00:23:45.945781+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:23:45.945781+0000","last_undegraded":"2023-09-28T00:23:45.945781+0000","last_fullsized":"2023-09-28T00:23:45.945781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.945643+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:22.905557+0000","scrub_duration":0.0014949780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189175+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:23:02.189175+0000","last_peered":"2023-09-28T00:23:02.189175+0000","last_clean":"2023-09-28T00:23:02.189175+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:23:02.189175+0000","last_undegraded":"2023-09-28T00:23:02.189175+0000","last_fullsized":"2023-09-28T00:23:02.189175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.589615+0000","last_change":"2023-09-28T00:23:34.589582+0000","last_active":"2023-09-28T00:23:34.589615+0000","last_peered":"2023-09-28T00:23:34.589615+0000","last_clean":"2023-09-28T00:23:34.589615+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:34.589615+0000","last_undegraded":"2023-09-28T00:23:34.589615+0000","last_fullsized":"2023-09-28T00:23:34.589615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.589490+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:12:13.514087+0000","scrub_duration":0.0039604139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.983259+0000","last_change":"2023-09-28T00:23:39.983230+0000","last_active":"2023-09-28T00:23:39.983259+0000","last_peered":"2023-09-28T00:23:39.983259+0000","last_clean":"2023-09-28T00:23:39.983259+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:23:39.983259+0000","last_undegraded":"2023-09-28T00:23:39.983259+0000","last_fullsized":"2023-09-28T00:23:39.983259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.983114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:31.406543+0000","scrub_duration":0.0015432110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.110943+0000","last_change":"2023-09-28T00:23:36.110868+0000","last_active":"2023-09-28T00:23:36.110943+0000","last_peered":"2023-09-28T00:23:36.110943+0000","last_clean":"2023-09-28T00:23:36.110943+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:36.110943+0000","last_undegraded":"2023-09-28T00:23:36.110943+0000","last_fullsized":"2023-09-28T00:23:36.110943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.110764+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:13.070678+0000","scrub_duration":0.0050075609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189247+0000","last_change":"2023-09-28T00:22:59.706581+0000","last_active":"2023-09-28T00:23:02.189247+0000","last_peered":"2023-09-28T00:23:02.189247+0000","last_clean":"2023-09-28T00:23:02.189247+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:23:02.189247+0000","last_undegraded":"2023-09-28T00:23:02.189247+0000","last_fullsized":"2023-09-28T00:23:02.189247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.413348+0000","last_change":"2023-09-28T00:23:38.413300+0000","last_active":"2023-09-28T00:23:38.413348+0000","last_peered":"2023-09-28T00:23:38.413348+0000","last_clean":"2023-09-28T00:23:38.413348+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:38.413348+0000","last_undegraded":"2023-09-28T00:23:38.413348+0000","last_fullsized":"2023-09-28T00:23:38.413348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.413180+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:20.986223+0000","scrub_duration":0.0028226290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189135+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:23:02.189135+0000","last_peered":"2023-09-28T00:23:02.189135+0000","last_clean":"2023-09-28T00:23:02.189135+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:23:02.189135+0000","last_undegraded":"2023-09-28T00:23:02.189135+0000","last_fullsized":"2023-09-28T00:23:02.189135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.399962+0000","last_change":"2023-09-28T00:23:37.399912+0000","last_active":"2023-09-28T00:23:37.399962+0000","last_peered":"2023-09-28T00:23:37.399962+0000","last_clean":"2023-09-28T00:23:37.399962+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:37.399962+0000","last_undegraded":"2023-09-28T00:23:37.399962+0000","last_fullsized":"2023-09-28T00:23:37.399962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.399783+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:14.359696+0000","scrub_duration":0.0050903859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189539+0000","last_change":"2023-09-28T00:22:59.714886+0000","last_active":"2023-09-28T00:23:02.189539+0000","last_peered":"2023-09-28T00:23:02.189539+0000","last_clean":"2023-09-28T00:23:02.189539+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:23:02.189539+0000","last_undegraded":"2023-09-28T00:23:02.189539+0000","last_fullsized":"2023-09-28T00:23:02.189539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.362266+0000","last_change":"2023-09-28T00:23:32.362236+0000","last_active":"2023-09-28T00:23:32.362266+0000","last_peered":"2023-09-28T00:23:32.362266+0000","last_clean":"2023-09-28T00:23:32.362266+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:32.362266+0000","last_undegraded":"2023-09-28T00:23:32.362266+0000","last_fullsized":"2023-09-28T00:23:32.362266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.362132+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:11:43.475524+0000","scrub_duration":0.001706475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188752+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:23:02.188752+0000","last_peered":"2023-09-28T00:23:02.188752+0000","last_clean":"2023-09-28T00:23:02.188752+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:23:02.188752+0000","last_undegraded":"2023-09-28T00:23:02.188752+0000","last_fullsized":"2023-09-28T00:23:02.188752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.294191+0000","last_change":"2023-09-28T00:23:32.294167+0000","last_active":"2023-09-28T00:23:32.294191+0000","last_peered":"2023-09-28T00:23:32.294191+0000","last_clean":"2023-09-28T00:23:32.294191+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:32.294191+0000","last_undegraded":"2023-09-28T00:23:32.294191+0000","last_fullsized":"2023-09-28T00:23:32.294191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.294091+0000","objects_scrubbed":4,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:06.602627+0000","scrub_duration":0.003875613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189297+0000","last_change":"2023-09-28T00:22:59.718912+0000","last_active":"2023-09-28T00:23:02.189297+0000","last_peered":"2023-09-28T00:23:02.189297+0000","last_clean":"2023-09-28T00:23:02.189297+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:23:02.189297+0000","last_undegraded":"2023-09-28T00:23:02.189297+0000","last_fullsized":"2023-09-28T00:23:02.189297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728916+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728916+0000","last_peered":"2023-09-28T00:23:05.728916+0000","last_clean":"2023-09-28T00:23:05.728916+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728916+0000","last_undegraded":"2023-09-28T00:23:05.728916+0000","last_fullsized":"2023-09-28T00:23:05.728916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.416914+0000","last_change":"2023-09-28T00:23:34.416862+0000","last_active":"2023-09-28T00:23:34.416914+0000","last_peered":"2023-09-28T00:23:34.416914+0000","last_clean":"2023-09-28T00:23:34.416914+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:23:34.416914+0000","last_undegraded":"2023-09-28T00:23:34.416914+0000","last_fullsized":"2023-09-28T00:23:34.416914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.416729+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:46.450761+0000","scrub_duration":0.0016463960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'9","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.726595+0000","last_change":"2023-09-28T00:22:59.214352+0000","last_active":"2023-09-28T00:23:05.726595+0000","last_peered":"2023-09-28T00:23:05.726595+0000","last_clean":"2023-09-28T00:23:05.726595+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:23:05.726595+0000","last_undegraded":"2023-09-28T00:23:05.726595+0000","last_fullsized":"2023-09-28T00:23:05.726595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189193+0000","last_change":"2023-09-28T00:22:59.697152+0000","last_active":"2023-09-28T00:23:02.189193+0000","last_peered":"2023-09-28T00:23:02.189193+0000","last_clean":"2023-09-28T00:23:02.189193+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:23:02.189193+0000","last_undegraded":"2023-09-28T00:23:02.189193+0000","last_fullsized":"2023-09-28T00:23:02.189193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.143134+0000","last_change":"2023-09-28T00:23:35.143103+0000","last_active":"2023-09-28T00:23:35.143134+0000","last_peered":"2023-09-28T00:23:35.143134+0000","last_clean":"2023-09-28T00:23:35.143134+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:35.143134+0000","last_undegraded":"2023-09-28T00:23:35.143134+0000","last_fullsized":"2023-09-28T00:23:35.143134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.143009+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:22.819982+0000","scrub_duration":0.0043366630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.077248+0000","last_change":"2023-09-28T00:23:44.077215+0000","last_active":"2023-09-28T00:23:44.077248+0000","last_peered":"2023-09-28T00:23:44.077248+0000","last_clean":"2023-09-28T00:23:44.077248+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:23:44.077248+0000","last_undegraded":"2023-09-28T00:23:44.077248+0000","last_fullsized":"2023-09-28T00:23:44.077248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.077114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:31.423889+0000","scrub_duration":0.0016410789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.134927+0000","last_change":"2023-09-28T00:23:39.134889+0000","last_active":"2023-09-28T00:23:39.134927+0000","last_peered":"2023-09-28T00:23:39.134927+0000","last_clean":"2023-09-28T00:23:39.134927+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:39.134927+0000","last_undegraded":"2023-09-28T00:23:39.134927+0000","last_fullsized":"2023-09-28T00:23:39.134927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.134801+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:08.531014+0000","scrub_duration":0.0043778289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691779+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:23:00.691779+0000","last_peered":"2023-09-28T00:23:00.691779+0000","last_clean":"2023-09-28T00:23:00.691779+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:23:00.691779+0000","last_undegraded":"2023-09-28T00:23:00.691779+0000","last_fullsized":"2023-09-28T00:23:00.691779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'21","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.575210+0000","last_change":"2023-09-28T00:23:32.575182+0000","last_active":"2023-09-28T00:23:32.575210+0000","last_peered":"2023-09-28T00:23:32.575210+0000","last_clean":"2023-09-28T00:23:32.575210+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:32.575210+0000","last_undegraded":"2023-09-28T00:23:32.575210+0000","last_fullsized":"2023-09-28T00:23:32.575210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.575111+0000","objects_scrubbed":8,"log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:28.818017+0000","scrub_duration":0.004538523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691971+0000","last_change":"2023-09-28T00:22:59.707478+0000","last_active":"2023-09-28T00:23:00.691971+0000","last_peered":"2023-09-28T00:23:00.691971+0000","last_clean":"2023-09-28T00:23:00.691971+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:23:00.691971+0000","last_undegraded":"2023-09-28T00:23:00.691971+0000","last_fullsized":"2023-09-28T00:23:00.691971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.319409+0000","last_change":"2023-09-28T00:23:29.319382+0000","last_active":"2023-09-28T00:23:29.319409+0000","last_peered":"2023-09-28T00:23:29.319409+0000","last_clean":"2023-09-28T00:23:29.319409+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:29.319409+0000","last_undegraded":"2023-09-28T00:23:29.319409+0000","last_fullsized":"2023-09-28T00:23:29.319409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.319298+0000","objects_scrubbed":2,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:16:37.432115+0000","scrub_duration":0.002326229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188365+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:23:02.188365+0000","last_peered":"2023-09-28T00:23:02.188365+0000","last_clean":"2023-09-28T00:23:02.188365+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:23:02.188365+0000","last_undegraded":"2023-09-28T00:23:02.188365+0000","last_fullsized":"2023-09-28T00:23:02.188365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.400420+0000","last_change":"2023-09-28T00:23:33.400388+0000","last_active":"2023-09-28T00:23:33.400420+0000","last_peered":"2023-09-28T00:23:33.400420+0000","last_clean":"2023-09-28T00:23:33.400420+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:33.400420+0000","last_undegraded":"2023-09-28T00:23:33.400420+0000","last_fullsized":"2023-09-28T00:23:33.400420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.400290+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:16:32.293022+0000","scrub_duration":0.0031017280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.549752+0000","last_change":"2023-09-28T00:23:38.549684+0000","last_active":"2023-09-28T00:23:38.549752+0000","last_peered":"2023-09-28T00:23:38.549752+0000","last_clean":"2023-09-28T00:23:38.549752+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:23:38.549752+0000","last_undegraded":"2023-09-28T00:23:38.549752+0000","last_fullsized":"2023-09-28T00:23:38.549752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.549532+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:38:59.086311+0000","scrub_duration":0.0020537279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.127159+0000","last_change":"2023-09-28T00:23:30.127112+0000","last_active":"2023-09-28T00:23:30.127159+0000","last_peered":"2023-09-28T00:23:30.127159+0000","last_clean":"2023-09-28T00:23:30.127159+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:30.127159+0000","last_undegraded":"2023-09-28T00:23:30.127159+0000","last_fullsized":"2023-09-28T00:23:30.127159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.127030+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:58.393189+0000","scrub_duration":0.00305843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.345983+0000","last_change":"2023-09-28T00:23:43.345944+0000","last_active":"2023-09-28T00:23:43.345983+0000","last_peered":"2023-09-28T00:23:43.345983+0000","last_clean":"2023-09-28T00:23:43.345983+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:23:43.345983+0000","last_undegraded":"2023-09-28T00:23:43.345983+0000","last_fullsized":"2023-09-28T00:23:43.345983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.345844+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:16.087415+0000","scrub_duration":0.0015894629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.278071+0000","last_change":"2023-09-28T00:23:33.278024+0000","last_active":"2023-09-28T00:23:33.278071+0000","last_peered":"2023-09-28T00:23:33.278071+0000","last_clean":"2023-09-28T00:23:33.278071+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:33.278071+0000","last_undegraded":"2023-09-28T00:23:33.278071+0000","last_fullsized":"2023-09-28T00:23:33.278071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.277933+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:20.954905+0000","scrub_duration":0.0026154009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.692683+0000","last_change":"2023-09-28T00:22:59.698095+0000","last_active":"2023-09-28T00:23:00.692683+0000","last_peered":"2023-09-28T00:23:00.692683+0000","last_clean":"2023-09-28T00:23:00.692683+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:23:00.692683+0000","last_undegraded":"2023-09-28T00:23:00.692683+0000","last_fullsized":"2023-09-28T00:23:00.692683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.958082+0000","last_change":"2023-09-28T00:23:36.958043+0000","last_active":"2023-09-28T00:23:36.958082+0000","last_peered":"2023-09-28T00:23:36.958082+0000","last_clean":"2023-09-28T00:23:36.958082+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:36.958082+0000","last_undegraded":"2023-09-28T00:23:36.958082+0000","last_fullsized":"2023-09-28T00:23:36.958082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.957909+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:24.634881+0000","scrub_duration":0.0032571900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.135317+0000","last_change":"2023-09-28T00:23:42.135283+0000","last_active":"2023-09-28T00:23:42.135317+0000","last_peered":"2023-09-28T00:23:42.135317+0000","last_clean":"2023-09-28T00:23:42.135317+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:23:42.135317+0000","last_undegraded":"2023-09-28T00:23:42.135317+0000","last_fullsized":"2023-09-28T00:23:42.135317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.135184+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:19.095098+0000","scrub_duration":0.001635837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.120381+0000","last_change":"2023-09-28T00:23:47.120329+0000","last_active":"2023-09-28T00:23:47.120381+0000","last_peered":"2023-09-28T00:23:47.120381+0000","last_clean":"2023-09-28T00:23:47.120381+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:47.120381+0000","last_undegraded":"2023-09-28T00:23:47.120381+0000","last_fullsized":"2023-09-28T00:23:47.120381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.120219+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:52.539761+0000","scrub_duration":0.0039619049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189360+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:23:02.189360+0000","last_peered":"2023-09-28T00:23:02.189360+0000","last_clean":"2023-09-28T00:23:02.189360+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:23:02.189360+0000","last_undegraded":"2023-09-28T00:23:02.189360+0000","last_fullsized":"2023-09-28T00:23:02.189360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725949+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725949+0000","last_peered":"2023-09-28T00:23:05.725949+0000","last_clean":"2023-09-28T00:23:05.725949+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725949+0000","last_undegraded":"2023-09-28T00:23:05.725949+0000","last_fullsized":"2023-09-28T00:23:05.725949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691356+0000","last_change":"2023-09-28T00:22:59.720447+0000","last_active":"2023-09-28T00:23:00.691356+0000","last_peered":"2023-09-28T00:23:00.691356+0000","last_clean":"2023-09-28T00:23:00.691356+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:23:00.691356+0000","last_undegraded":"2023-09-28T00:23:00.691356+0000","last_fullsized":"2023-09-28T00:23:00.691356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.085810+0000","last_change":"2023-09-28T00:23:35.085780+0000","last_active":"2023-09-28T00:23:35.085810+0000","last_peered":"2023-09-28T00:23:35.085810+0000","last_clean":"2023-09-28T00:23:35.085810+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:35.085810+0000","last_undegraded":"2023-09-28T00:23:35.085810+0000","last_fullsized":"2023-09-28T00:23:35.085810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.085669+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:37.538489+0000","scrub_duration":0.0028376410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.992118+0000","last_change":"2023-09-28T00:23:47.992070+0000","last_active":"2023-09-28T00:23:47.992118+0000","last_peered":"2023-09-28T00:23:47.992118+0000","last_clean":"2023-09-28T00:23:47.992118+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:23:47.992118+0000","last_undegraded":"2023-09-28T00:23:47.992118+0000","last_fullsized":"2023-09-28T00:23:47.992118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.991945+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:27.276590+0000","scrub_duration":0.0016691169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.390807+0000","last_change":"2023-09-28T00:23:32.390774+0000","last_active":"2023-09-28T00:23:32.390807+0000","last_peered":"2023-09-28T00:23:32.390807+0000","last_clean":"2023-09-28T00:23:32.390807+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:23:32.390807+0000","last_undegraded":"2023-09-28T00:23:32.390807+0000","last_fullsized":"2023-09-28T00:23:32.390807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.390659+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:23.814089+0000","scrub_duration":0.001476237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.350385+0000","last_change":"2023-09-28T00:23:29.350352+0000","last_active":"2023-09-28T00:23:29.350385+0000","last_peered":"2023-09-28T00:23:29.350385+0000","last_clean":"2023-09-28T00:23:29.350385+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:29.350385+0000","last_undegraded":"2023-09-28T00:23:29.350385+0000","last_fullsized":"2023-09-28T00:23:29.350385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.350273+0000","objects_scrubbed":3,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:06:24.282255+0000","scrub_duration":0.0024491669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188727+0000","last_change":"2023-09-28T00:22:59.711820+0000","last_active":"2023-09-28T00:23:02.188727+0000","last_peered":"2023-09-28T00:23:02.188727+0000","last_clean":"2023-09-28T00:23:02.188727+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:23:02.188727+0000","last_undegraded":"2023-09-28T00:23:02.188727+0000","last_fullsized":"2023-09-28T00:23:02.188727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188945+0000","last_change":"2023-09-28T00:22:54.431383+0000","last_active":"2023-09-28T00:23:02.188945+0000","last_peered":"2023-09-28T00:23:02.188945+0000","last_clean":"2023-09-28T00:23:02.188945+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:23:02.188945+0000","last_undegraded":"2023-09-28T00:23:02.188945+0000","last_fullsized":"2023-09-28T00:23:02.188945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.293946+0000","last_change":"2023-09-28T00:23:30.293921+0000","last_active":"2023-09-28T00:23:30.293946+0000","last_peered":"2023-09-28T00:23:30.293946+0000","last_clean":"2023-09-28T00:23:30.293946+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:30.293946+0000","last_undegraded":"2023-09-28T00:23:30.293946+0000","last_fullsized":"2023-09-28T00:23:30.293946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.293841+0000","objects_scrubbed":5,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:23.134625+0000","scrub_duration":0.002485498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.095642+0000","last_change":"2023-09-28T00:23:46.095610+0000","last_active":"2023-09-28T00:23:46.095642+0000","last_peered":"2023-09-28T00:23:46.095642+0000","last_clean":"2023-09-28T00:23:46.095642+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:23:46.095642+0000","last_undegraded":"2023-09-28T00:23:46.095642+0000","last_fullsized":"2023-09-28T00:23:46.095642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.095492+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:25.380137+0000","scrub_duration":0.0014021330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.956906+0000","last_change":"2023-09-28T00:23:35.956877+0000","last_active":"2023-09-28T00:23:35.956906+0000","last_peered":"2023-09-28T00:23:35.956906+0000","last_clean":"2023-09-28T00:23:35.956906+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:23:35.956906+0000","last_undegraded":"2023-09-28T00:23:35.956906+0000","last_fullsized":"2023-09-28T00:23:35.956906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.956762+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:10.265298+0000","scrub_duration":0.00159213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.385146+0000","last_change":"2023-09-28T00:23:35.385107+0000","last_active":"2023-09-28T00:23:35.385146+0000","last_peered":"2023-09-28T00:23:35.385146+0000","last_clean":"2023-09-28T00:23:35.385146+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:35.385146+0000","last_undegraded":"2023-09-28T00:23:35.385146+0000","last_fullsized":"2023-09-28T00:23:35.385146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.384999+0000","objects_scrubbed":1,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:56.683879+0000","scrub_duration":0.003022407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.111930+0000","last_change":"2023-09-28T00:23:44.111895+0000","last_active":"2023-09-28T00:23:44.111930+0000","last_peered":"2023-09-28T00:23:44.111930+0000","last_clean":"2023-09-28T00:23:44.111930+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:23:44.111930+0000","last_undegraded":"2023-09-28T00:23:44.111930+0000","last_fullsized":"2023-09-28T00:23:44.111930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.111778+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:21.071692+0000","scrub_duration":0.0020723899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189052+0000","last_change":"2023-09-28T00:22:54.432445+0000","last_active":"2023-09-28T00:23:02.189052+0000","last_peered":"2023-09-28T00:23:02.189052+0000","last_clean":"2023-09-28T00:23:02.189052+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:23:02.189052+0000","last_undegraded":"2023-09-28T00:23:02.189052+0000","last_fullsized":"2023-09-28T00:23:02.189052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.534399+0000","last_change":"2023-09-28T00:23:31.534372+0000","last_active":"2023-09-28T00:23:31.534399+0000","last_peered":"2023-09-28T00:23:31.534399+0000","last_clean":"2023-09-28T00:23:31.534399+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:23:31.534399+0000","last_undegraded":"2023-09-28T00:23:31.534399+0000","last_fullsized":"2023-09-28T00:23:31.534399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.534296+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:08:14.007270+0000","scrub_duration":0.0047438030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.142763+0000","last_change":"2023-09-28T00:23:37.142735+0000","last_active":"2023-09-28T00:23:37.142763+0000","last_peered":"2023-09-28T00:23:37.142763+0000","last_clean":"2023-09-28T00:23:37.142763+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:37.142763+0000","last_undegraded":"2023-09-28T00:23:37.142763+0000","last_fullsized":"2023-09-28T00:23:37.142763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.142635+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:19.715678+0000","scrub_duration":0.0044461099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189335+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:23:02.189335+0000","last_peered":"2023-09-28T00:23:02.189335+0000","last_clean":"2023-09-28T00:23:02.189335+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:23:02.189335+0000","last_undegraded":"2023-09-28T00:23:02.189335+0000","last_fullsized":"2023-09-28T00:23:02.189335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188218+0000","last_change":"2023-09-28T00:22:54.171780+0000","last_active":"2023-09-28T00:23:02.188218+0000","last_peered":"2023-09-28T00:23:02.188218+0000","last_clean":"2023-09-28T00:23:02.188218+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:23:02.188218+0000","last_undegraded":"2023-09-28T00:23:02.188218+0000","last_fullsized":"2023-09-28T00:23:02.188218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.146002+0000","last_change":"2023-09-28T00:23:32.145963+0000","last_active":"2023-09-28T00:23:32.146002+0000","last_peered":"2023-09-28T00:23:32.146002+0000","last_clean":"2023-09-28T00:23:32.146002+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:32.146002+0000","last_undegraded":"2023-09-28T00:23:32.146002+0000","last_fullsized":"2023-09-28T00:23:32.146002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.145842+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:24.986625+0000","scrub_duration":0.0025902830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.442472+0000","last_change":"2023-09-28T00:23:46.442444+0000","last_active":"2023-09-28T00:23:46.442472+0000","last_peered":"2023-09-28T00:23:46.442472+0000","last_clean":"2023-09-28T00:23:46.442472+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:23:46.442472+0000","last_undegraded":"2023-09-28T00:23:46.442472+0000","last_fullsized":"2023-09-28T00:23:46.442472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.442331+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:15.838545+0000","scrub_duration":0.0013918260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189260+0000","last_change":"2023-09-28T00:22:54.171542+0000","last_active":"2023-09-28T00:23:02.189260+0000","last_peered":"2023-09-28T00:23:02.189260+0000","last_clean":"2023-09-28T00:23:02.189260+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:23:02.189260+0000","last_undegraded":"2023-09-28T00:23:02.189260+0000","last_fullsized":"2023-09-28T00:23:02.189260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.160690+0000","last_change":"2023-09-28T00:23:38.160661+0000","last_active":"2023-09-28T00:23:38.160690+0000","last_peered":"2023-09-28T00:23:38.160690+0000","last_clean":"2023-09-28T00:23:38.160690+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:38.160690+0000","last_undegraded":"2023-09-28T00:23:38.160690+0000","last_fullsized":"2023-09-28T00:23:38.160690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.160543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:29.583972+0000","scrub_duration":0.0015551149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.149982+0000","last_change":"2023-09-28T00:23:43.149946+0000","last_active":"2023-09-28T00:23:43.149982+0000","last_peered":"2023-09-28T00:23:43.149982+0000","last_clean":"2023-09-28T00:23:43.149982+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:23:43.149982+0000","last_undegraded":"2023-09-28T00:23:43.149982+0000","last_fullsized":"2023-09-28T00:23:43.149982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.149846+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:45.602666+0000","scrub_duration":0.0019646730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'11","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.073095+0000","last_change":"2023-09-28T00:23:45.073062+0000","last_active":"2023-09-28T00:23:45.073095+0000","last_peered":"2023-09-28T00:23:45.073095+0000","last_clean":"2023-09-28T00:23:45.073095+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:45.073095+0000","last_undegraded":"2023-09-28T00:23:45.073095+0000","last_fullsized":"2023-09-28T00:23:45.073095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.072959+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:14.469172+0000","scrub_duration":0.0043027669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.049288+0000","last_change":"2023-09-28T00:23:31.049243+0000","last_active":"2023-09-28T00:23:31.049288+0000","last_peered":"2023-09-28T00:23:31.049288+0000","last_clean":"2023-09-28T00:23:31.049288+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:23:31.049288+0000","last_undegraded":"2023-09-28T00:23:31.049288+0000","last_fullsized":"2023-09-28T00:23:31.049288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.049126+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:22.472556+0000","scrub_duration":0.0016726429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188822+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:23:02.188822+0000","last_peered":"2023-09-28T00:23:02.188822+0000","last_clean":"2023-09-28T00:23:02.188822+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:23:02.188822+0000","last_undegraded":"2023-09-28T00:23:02.188822+0000","last_fullsized":"2023-09-28T00:23:02.188822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189022+0000","last_change":"2023-09-28T00:22:54.172087+0000","last_active":"2023-09-28T00:23:02.189022+0000","last_peered":"2023-09-28T00:23:02.189022+0000","last_clean":"2023-09-28T00:23:02.189022+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:23:02.189022+0000","last_undegraded":"2023-09-28T00:23:02.189022+0000","last_fullsized":"2023-09-28T00:23:02.189022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:53.154327+0000","last_clean_scrub_stamp":"2023-09-28T00:22:53.154327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.084444+0000","last_change":"2023-09-28T00:23:34.084410+0000","last_active":"2023-09-28T00:23:34.084444+0000","last_peered":"2023-09-28T00:23:34.084444+0000","last_clean":"2023-09-28T00:23:34.084444+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:34.084444+0000","last_undegraded":"2023-09-28T00:23:34.084444+0000","last_fullsized":"2023-09-28T00:23:34.084444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.084301+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:55.383181+0000","scrub_duration":0.003197971,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.323131+0000","last_change":"2023-09-28T00:23:42.323097+0000","last_active":"2023-09-28T00:23:42.323131+0000","last_peered":"2023-09-28T00:23:42.323131+0000","last_clean":"2023-09-28T00:23:42.323131+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:23:42.323131+0000","last_undegraded":"2023-09-28T00:23:42.323131+0000","last_fullsized":"2023-09-28T00:23:42.323131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.322988+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:38.153260+0000","scrub_duration":0.0016894810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.081883+0000","last_change":"2023-09-28T00:23:39.081826+0000","last_active":"2023-09-28T00:23:39.081883+0000","last_peered":"2023-09-28T00:23:39.081883+0000","last_clean":"2023-09-28T00:23:39.081883+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:39.081883+0000","last_undegraded":"2023-09-28T00:23:39.081883+0000","last_fullsized":"2023-09-28T00:23:39.081883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.081717+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:03.473134+0000","scrub_duration":0.0047997099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189193+0000","last_change":"2023-09-28T00:22:59.704968+0000","last_active":"2023-09-28T00:23:02.189193+0000","last_peered":"2023-09-28T00:23:02.189193+0000","last_clean":"2023-09-28T00:23:02.189193+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:23:02.189193+0000","last_undegraded":"2023-09-28T00:23:02.189193+0000","last_fullsized":"2023-09-28T00:23:02.189193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.608016+0000","last_change":"2023-09-28T00:23:33.607964+0000","last_active":"2023-09-28T00:23:33.608016+0000","last_peered":"2023-09-28T00:23:33.608016+0000","last_clean":"2023-09-28T00:23:33.608016+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:33.608016+0000","last_undegraded":"2023-09-28T00:23:33.608016+0000","last_fullsized":"2023-09-28T00:23:33.608016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.607850+0000","objects_scrubbed":3,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:45.641882+0000","scrub_duration":0.003579807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691213+0000","last_change":"2023-09-28T00:22:59.707218+0000","last_active":"2023-09-28T00:23:00.691213+0000","last_peered":"2023-09-28T00:23:00.691213+0000","last_clean":"2023-09-28T00:23:00.691213+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:23:00.691213+0000","last_undegraded":"2023-09-28T00:23:00.691213+0000","last_fullsized":"2023-09-28T00:23:00.691213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'13","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.069809+0000","last_change":"2023-09-28T00:23:33.069768+0000","last_active":"2023-09-28T00:23:33.069809+0000","last_peered":"2023-09-28T00:23:33.069809+0000","last_clean":"2023-09-28T00:23:33.069809+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:33.069809+0000","last_undegraded":"2023-09-28T00:23:33.069809+0000","last_fullsized":"2023-09-28T00:23:33.069809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.069686+0000","objects_scrubbed":7,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:12.354331+0000","scrub_duration":0.0030685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691101+0000","last_change":"2023-09-28T00:22:59.711509+0000","last_active":"2023-09-28T00:23:00.691101+0000","last_peered":"2023-09-28T00:23:00.691101+0000","last_clean":"2023-09-28T00:23:00.691101+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:23:00.691101+0000","last_undegraded":"2023-09-28T00:23:00.691101+0000","last_fullsized":"2023-09-28T00:23:00.691101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.390499+0000","last_change":"2023-09-28T00:23:36.390460+0000","last_active":"2023-09-28T00:23:36.390499+0000","last_peered":"2023-09-28T00:23:36.390499+0000","last_clean":"2023-09-28T00:23:36.390499+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:36.390499+0000","last_undegraded":"2023-09-28T00:23:36.390499+0000","last_fullsized":"2023-09-28T00:23:36.390499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.390358+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:38.843177+0000","scrub_duration":0.002166659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.911467+0000","last_change":"2023-09-28T00:23:44.911437+0000","last_active":"2023-09-28T00:23:44.911467+0000","last_peered":"2023-09-28T00:23:44.911467+0000","last_clean":"2023-09-28T00:23:44.911467+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:23:44.911467+0000","last_undegraded":"2023-09-28T00:23:44.911467+0000","last_fullsized":"2023-09-28T00:23:44.911467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.911323+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:47.364143+0000","scrub_duration":0.001669542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'19","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.462441+0000","last_change":"2023-09-28T00:23:40.462404+0000","last_active":"2023-09-28T00:23:40.462441+0000","last_peered":"2023-09-28T00:23:40.462441+0000","last_clean":"2023-09-28T00:23:40.462441+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:40.462441+0000","last_undegraded":"2023-09-28T00:23:40.462441+0000","last_fullsized":"2023-09-28T00:23:40.462441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.462229+0000","objects_scrubbed":6,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:04.853646+0000","scrub_duration":0.0064632149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.416065+0000","last_change":"2023-09-28T00:23:47.416035+0000","last_active":"2023-09-28T00:23:47.416065+0000","last_peered":"2023-09-28T00:23:47.416065+0000","last_clean":"2023-09-28T00:23:47.416065+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:23:47.416065+0000","last_undegraded":"2023-09-28T00:23:47.416065+0000","last_fullsized":"2023-09-28T00:23:47.416065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.415939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:46.034885+0000","scrub_duration":0.001829188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:01.546370+0000","last_change":"2023-09-28T00:22:59.701662+0000","last_active":"2023-09-28T00:23:01.546370+0000","last_peered":"2023-09-28T00:23:01.546370+0000","last_clean":"2023-09-28T00:23:01.546370+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:23:01.546370+0000","last_undegraded":"2023-09-28T00:23:01.546370+0000","last_fullsized":"2023-09-28T00:23:01.546370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188996+0000","last_change":"2023-09-28T00:22:59.699801+0000","last_active":"2023-09-28T00:23:02.188996+0000","last_peered":"2023-09-28T00:23:02.188996+0000","last_clean":"2023-09-28T00:23:02.188996+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:23:02.188996+0000","last_undegraded":"2023-09-28T00:23:02.188996+0000","last_fullsized":"2023-09-28T00:23:02.188996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.135639+0000","last_change":"2023-09-28T00:23:40.135600+0000","last_active":"2023-09-28T00:23:40.135639+0000","last_peered":"2023-09-28T00:23:40.135639+0000","last_clean":"2023-09-28T00:23:40.135639+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:23:40.135639+0000","last_undegraded":"2023-09-28T00:23:40.135639+0000","last_fullsized":"2023-09-28T00:23:40.135639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.135470+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:01.434350+0000","scrub_duration":0.0016553480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.692743+0000","last_change":"2023-09-28T00:22:59.707904+0000","last_active":"2023-09-28T00:23:00.692743+0000","last_peered":"2023-09-28T00:23:00.692743+0000","last_clean":"2023-09-28T00:23:00.692743+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:23:00.692743+0000","last_undegraded":"2023-09-28T00:23:00.692743+0000","last_fullsized":"2023-09-28T00:23:00.692743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691914+0000","last_change":"2023-09-28T00:22:59.707048+0000","last_active":"2023-09-28T00:23:00.691914+0000","last_peered":"2023-09-28T00:23:00.691914+0000","last_clean":"2023-09-28T00:23:00.691914+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:23:00.691914+0000","last_undegraded":"2023-09-28T00:23:00.691914+0000","last_fullsized":"2023-09-28T00:23:00.691914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19520,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12208,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359632,"statfs":{"total":96636764160,"available":96624263168,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.874}]},{"osd":5,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.69399999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13348,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358492,"statfs":{"total":96636764160,"available":96623095808,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.752},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.008}]},{"osd":5,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.87},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.97699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.755},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.91600000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.871},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.0229999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.437}]},{"osd":5,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.875},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.314},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33900000000000002}]},{"osd":6,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.36199999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.372}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9252,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362588,"statfs":{"total":96636764160,"available":96627290112,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.432},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.443}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8104,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363736,"statfs":{"total":96636764160,"available":96628465664,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.88500000000000001}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:23:53.082 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.083 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.083 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.083 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.083 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.083 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.084 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.084 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.084 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.084 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.084 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.084 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.085 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.085 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.085 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.085 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.085 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.086 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.086 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.086 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.086 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.086 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.087 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.087 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.087 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.087 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.087 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.088 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.088 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.088 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.088 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.088 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.089 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.089 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.089 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.089 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.089 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.090 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.090 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.090 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.090 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.090 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T00:22:53.154327+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=53, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.091 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.091 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.091 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.091 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.091 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.092 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.092 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:23:53.092 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:23:59.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:23:59.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:24:13.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:24:13.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.292+0000 7f7987fff700 1 Processor -- start 2023-09-28T00:24:13.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.293+0000 7f7987fff700 1 -- start start 2023-09-28T00:24:13.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f7987fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f798814bf10 0x7f7988155f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:13.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f7987fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7988089830 0x7f79880ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:13.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f7987fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79880ca4b0 con 0x7f79880adde0 2023-09-28T00:24:13.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f7987fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79880ae5f0 con 0x7f798814bf10 2023-09-28T00:24:13.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f7987fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7988156440 con 0x7f7988089830 2023-09-28T00:24:13.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f7986ffd700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f798814bf10 0x7f7988155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f79877fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f79880adde0 0x7f79880ca940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51174/0 (socket says 172.21.15.53:51174) 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f79877fe700 1 -- 172.21.15.53:0/136446183 learned_addr learned my addr 172.21.15.53:0/136446183 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.294+0000 7f79867fc700 1 --2- 172.21.15.53:0/136446183 >> v2:172.21.15.118:3300/0 conn(0x7f7988089830 0x7f79880ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7986ffd700 1 -- 172.21.15.53:0/136446183 >> v2:172.21.15.118:3300/0 conn(0x7f7988089830 msgr2=0x7f79880ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7986ffd700 1 --2- 172.21.15.53:0/136446183 >> v2:172.21.15.118:3300/0 conn(0x7f7988089830 0x7f79880ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7986ffd700 1 -- 172.21.15.53:0/136446183 >> v1:172.21.15.53:6789/0 conn(0x7f79880adde0 legacy=0x7f79880ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7986ffd700 1 -- 172.21.15.53:0/136446183 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880c9bf0 con 0x7f798814bf10 2023-09-28T00:24:13.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7985ffb700 1 -- 172.21.15.53:0/136446183 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747907657 0 0) 0x7f79880ca4b0 con 0x7f79880adde0 2023-09-28T00:24:13.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7986ffd700 1 --2- 172.21.15.53:0/136446183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f7988155f00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7988089ce0 tx=0x7f79780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54926f40e143c923 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:13.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7985ffb700 1 -- 172.21.15.53:0/136446183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011630 con 0x7f798814bf10 2023-09-28T00:24:13.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7985ffb700 1 -- 172.21.15.53:0/136446183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978011790 con 0x7f798814bf10 2023-09-28T00:24:13.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.295+0000 7f7985ffb700 1 -- 172.21.15.53:0/136446183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011b30 con 0x7f798814bf10 2023-09-28T00:24:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 -- 172.21.15.53:0/136446183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 msgr2=0x7f7988155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 --2- 172.21.15.53:0/136446183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f7988155f00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7988089ce0 tx=0x7f79780091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 -- 172.21.15.53:0/136446183 shutdown_connections 2023-09-28T00:24:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 --2- 172.21.15.53:0/136446183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f7988155f00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 --2- 172.21.15.53:0/136446183 >> v2:172.21.15.118:3300/0 conn(0x7f7988089830 0x7f79880ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 -- 172.21.15.53:0/136446183 >> 172.21.15.53:0/136446183 conn(0x7f798806f830 msgr2=0x7f79880cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 -- 172.21.15.53:0/136446183 shutdown_connections 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.296+0000 7f7987fff700 1 -- 172.21.15.53:0/136446183 wait complete. 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.297+0000 7f7987fff700 1 Processor -- start 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.297+0000 7f7987fff700 1 -- start start 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.298+0000 7f7987fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988089830 0x7f79881659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.298+0000 7f7987fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79880adde0 0x7f798814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.298+0000 7f7987fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f79880b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.298+0000 7f7987fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988165f20 con 0x7f798814bf10 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.298+0000 7f7987fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798814f8f0 con 0x7f7988089830 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.298+0000 7f7987fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798814e250 con 0x7f79880adde0 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f79880b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f79880b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47422/0 (socket says 172.21.15.53:47422) 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 -- 172.21.15.53:0/3246875545 learned_addr learned my addr 172.21.15.53:0/3246875545 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f7986ffd700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988089830 0x7f79881659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79867fc700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79880adde0 0x7f798814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 -- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79880adde0 msgr2=0x7f798814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79880adde0 0x7f798814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 -- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988089830 msgr2=0x7f79881659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988089830 0x7f79881659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 -- 172.21.15.53:0/3246875545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978009420 con 0x7f798814bf10 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f79877fe700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f79880b05d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f798000ccc0 tx=0x7f7980001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.299+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000a8a0 con 0x7f798814bf10 2023-09-28T00:24:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.300+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798000aa00 con 0x7f798814bf10 2023-09-28T00:24:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.300+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000adc0 con 0x7f798814bf10 2023-09-28T00:24:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.300+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798814f610 con 0x7f798814bf10 2023-09-28T00:24:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.300+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798814dc00 con 0x7f798814bf10 2023-09-28T00:24:13.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.301+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798804c3c0 con 0x7f798814bf10 2023-09-28T00:24:13.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.301+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7980007300 con 0x7f798814bf10 2023-09-28T00:24:13.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.303+0000 7f796effd700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7974067360 0x7f7974069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:13.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.303+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7980084e40 con 0x7f798814bf10 2023-09-28T00:24:13.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.303+0000 7f7986ffd700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7974067360 0x7f7974069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:13.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.304+0000 7f7986ffd700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7974067360 0x7f7974069810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79780093f0 tx=0x7f7978017000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:13.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.307+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7980051d20 con 0x7f798814bf10 2023-09-28T00:24:13.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.504+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f798814e390 con 0x7f7974067360 2023-09-28T00:24:13.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.513+0000 7f796effd700 1 -- 172.21.15.53:0/3246875545 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310186 (secure 0 0 0) 0x7f798814e390 con 0x7f7974067360 2023-09-28T00:24:13.517 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:24:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7974067360 msgr2=0x7f7974069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7974067360 0x7f7974069810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79780093f0 tx=0x7f7978017000 comp rx=0 tx=0).stop 2023-09-28T00:24:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 msgr2=0x7f79880b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f79880b05d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f798000ccc0 tx=0x7f7980001a80 comp rx=0 tx=0).stop 2023-09-28T00:24:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 shutdown_connections 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f7974067360 0x7f7974069810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f798814bf10 0x7f79880b05d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7988089830 0x7f79881659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 --2- 172.21.15.53:0/3246875545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79880adde0 0x7f798814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 >> 172.21.15.53:0/3246875545 conn(0x7f798806f830 msgr2=0x7f798814b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 shutdown_connections 2023-09-28T00:24:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:13.518+0000 7f7987fff700 1 -- 172.21.15.53:0/3246875545 wait complete. 2023-09-28T00:24:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:24:13.535 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-09-28T00:24:13.121718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24400,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":83816,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":80320,"kb_avail":754890904,"statfs":{"total":773094113280,"available":773008285696,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82247680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003479"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691855+0000","last_change":"2023-09-28T00:22:59.702577+0000","last_active":"2023-09-28T00:23:00.691855+0000","last_peered":"2023-09-28T00:23:00.691855+0000","last_clean":"2023-09-28T00:23:00.691855+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:23:00.691855+0000","last_undegraded":"2023-09-28T00:23:00.691855+0000","last_fullsized":"2023-09-28T00:23:00.691855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:04.341391+0000","last_change":"2023-09-28T00:24:04.341360+0000","last_active":"2023-09-28T00:24:04.341391+0000","last_peered":"2023-09-28T00:24:04.341391+0000","last_clean":"2023-09-28T00:24:04.341391+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:24:04.341391+0000","last_undegraded":"2023-09-28T00:24:04.341391+0000","last_fullsized":"2023-09-28T00:24:04.341391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:04.341258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:04.341258+0000","last_clean_scrub_stamp":"2023-09-28T00:24:04.341258+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:18.025763+0000","scrub_duration":0.0021714389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.092457+0000","last_change":"2023-09-28T00:23:44.092424+0000","last_active":"2023-09-28T00:23:44.092457+0000","last_peered":"2023-09-28T00:23:44.092457+0000","last_clean":"2023-09-28T00:23:44.092457+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:23:44.092457+0000","last_undegraded":"2023-09-28T00:23:44.092457+0000","last_fullsized":"2023-09-28T00:23:44.092457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.092327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:23.376972+0000","scrub_duration":0.002012476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.097707+0000","last_change":"2023-09-28T00:23:43.097674+0000","last_active":"2023-09-28T00:23:43.097707+0000","last_peered":"2023-09-28T00:23:43.097707+0000","last_clean":"2023-09-28T00:23:43.097707+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:23:43.097707+0000","last_undegraded":"2023-09-28T00:23:43.097707+0000","last_fullsized":"2023-09-28T00:23:43.097707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.097578+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:25.670621+0000","scrub_duration":0.0022080009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:50.063926+0000","last_change":"2023-09-28T00:23:50.063885+0000","last_active":"2023-09-28T00:23:50.063926+0000","last_peered":"2023-09-28T00:23:50.063926+0000","last_clean":"2023-09-28T00:23:50.063926+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:23:50.063926+0000","last_undegraded":"2023-09-28T00:23:50.063926+0000","last_fullsized":"2023-09-28T00:23:50.063926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:50.063776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:50.063776+0000","last_clean_scrub_stamp":"2023-09-28T00:23:50.063776+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:37.410551+0000","scrub_duration":0.0022425600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188867+0000","last_change":"2023-09-28T00:22:59.714280+0000","last_active":"2023-09-28T00:23:02.188867+0000","last_peered":"2023-09-28T00:23:02.188867+0000","last_clean":"2023-09-28T00:23:02.188867+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:23:02.188867+0000","last_undegraded":"2023-09-28T00:23:02.188867+0000","last_fullsized":"2023-09-28T00:23:02.188867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188459+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:23:02.188459+0000","last_peered":"2023-09-28T00:23:02.188459+0000","last_clean":"2023-09-28T00:23:02.188459+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:23:02.188459+0000","last_undegraded":"2023-09-28T00:23:02.188459+0000","last_fullsized":"2023-09-28T00:23:02.188459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.579129+0000","last_change":"2023-09-28T00:24:06.579084+0000","last_active":"2023-09-28T00:24:06.579129+0000","last_peered":"2023-09-28T00:24:06.579129+0000","last_clean":"2023-09-28T00:24:06.579129+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:24:06.579129+0000","last_undegraded":"2023-09-28T00:24:06.579129+0000","last_fullsized":"2023-09-28T00:24:06.579129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.578982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.578982+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.578982+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:18:42.714759+0000","scrub_duration":0.0016678210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189192+0000","last_change":"2023-09-28T00:22:59.703895+0000","last_active":"2023-09-28T00:23:02.189192+0000","last_peered":"2023-09-28T00:23:02.189192+0000","last_clean":"2023-09-28T00:23:02.189192+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:23:02.189192+0000","last_undegraded":"2023-09-28T00:23:02.189192+0000","last_fullsized":"2023-09-28T00:23:02.189192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:53.568494+0000","last_change":"2023-09-28T00:23:53.568434+0000","last_active":"2023-09-28T00:23:53.568494+0000","last_peered":"2023-09-28T00:23:53.568494+0000","last_clean":"2023-09-28T00:23:53.568494+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:23:53.568494+0000","last_undegraded":"2023-09-28T00:23:53.568494+0000","last_fullsized":"2023-09-28T00:23:53.568494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:53.568345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:53.568345+0000","last_clean_scrub_stamp":"2023-09-28T00:23:53.568345+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:54.324883+0000","scrub_duration":0.001952344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.529212+0000","last_change":"2023-09-28T00:23:44.529175+0000","last_active":"2023-09-28T00:23:44.529212+0000","last_peered":"2023-09-28T00:23:44.529212+0000","last_clean":"2023-09-28T00:23:44.529212+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:23:44.529212+0000","last_undegraded":"2023-09-28T00:23:44.529212+0000","last_fullsized":"2023-09-28T00:23:44.529212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.529073+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:43.148019+0000","scrub_duration":0.001863382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:51.441168+0000","last_change":"2023-09-28T00:23:51.441138+0000","last_active":"2023-09-28T00:23:51.441168+0000","last_peered":"2023-09-28T00:23:51.441168+0000","last_clean":"2023-09-28T00:23:51.441168+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:23:51.441168+0000","last_undegraded":"2023-09-28T00:23:51.441168+0000","last_fullsized":"2023-09-28T00:23:51.441168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:51.441024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:51.441024+0000","last_clean_scrub_stamp":"2023-09-28T00:23:51.441024+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:38.787799+0000","scrub_duration":0.0027549929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:03.119660+0000","last_change":"2023-09-28T00:24:03.119631+0000","last_active":"2023-09-28T00:24:03.119660+0000","last_peered":"2023-09-28T00:24:03.119660+0000","last_clean":"2023-09-28T00:24:03.119660+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:24:03.119660+0000","last_undegraded":"2023-09-28T00:24:03.119660+0000","last_fullsized":"2023-09-28T00:24:03.119660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:03.119506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:03.119506+0000","last_clean_scrub_stamp":"2023-09-28T00:24:03.119506+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:20.043797+0000","scrub_duration":0.001752904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.544101+0000","last_change":"2023-09-28T00:23:39.544046+0000","last_active":"2023-09-28T00:23:39.544101+0000","last_peered":"2023-09-28T00:23:39.544101+0000","last_clean":"2023-09-28T00:23:39.544101+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:23:39.544101+0000","last_undegraded":"2023-09-28T00:23:39.544101+0000","last_fullsized":"2023-09-28T00:23:39.544101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.543902+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:35.374173+0000","scrub_duration":0.0021413439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.235617+0000","last_change":"2023-09-28T00:23:36.235585+0000","last_active":"2023-09-28T00:23:36.235617+0000","last_peered":"2023-09-28T00:23:36.235617+0000","last_clean":"2023-09-28T00:23:36.235617+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:23:36.235617+0000","last_undegraded":"2023-09-28T00:23:36.235617+0000","last_fullsized":"2023-09-28T00:23:36.235617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.235489+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:27.658919+0000","scrub_duration":0.0021098010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188346+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:23:02.188346+0000","last_peered":"2023-09-28T00:23:02.188346+0000","last_clean":"2023-09-28T00:23:02.188346+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:23:02.188346+0000","last_undegraded":"2023-09-28T00:23:02.188346+0000","last_fullsized":"2023-09-28T00:23:02.188346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:02.134888+0000","last_change":"2023-09-28T00:24:02.134862+0000","last_active":"2023-09-28T00:24:02.134888+0000","last_peered":"2023-09-28T00:24:02.134888+0000","last_clean":"2023-09-28T00:24:02.134888+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:24:02.134888+0000","last_undegraded":"2023-09-28T00:24:02.134888+0000","last_fullsized":"2023-09-28T00:24:02.134888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:02.134758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:02.134758+0000","last_clean_scrub_stamp":"2023-09-28T00:24:02.134758+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:27:07.554300+0000","scrub_duration":0.0014282069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:41.178631+0000","last_change":"2023-09-28T00:23:41.178598+0000","last_active":"2023-09-28T00:23:41.178631+0000","last_peered":"2023-09-28T00:23:41.178631+0000","last_clean":"2023-09-28T00:23:41.178631+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:23:41.178631+0000","last_undegraded":"2023-09-28T00:23:41.178631+0000","last_fullsized":"2023-09-28T00:23:41.178631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_clean_scrub_stamp":"2023-09-28T00:23:41.178477+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:43.631297+0000","scrub_duration":0.0018761540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.468694+0000","last_change":"2023-09-28T00:23:56.468670+0000","last_active":"2023-09-28T00:23:56.468694+0000","last_peered":"2023-09-28T00:23:56.468694+0000","last_clean":"2023-09-28T00:23:56.468694+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:23:56.468694+0000","last_undegraded":"2023-09-28T00:23:56.468694+0000","last_fullsized":"2023-09-28T00:23:56.468694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.468571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.468571+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.468571+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:13.392863+0000","scrub_duration":0.0018490830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.532040+0000","last_change":"2023-09-28T00:23:54.531991+0000","last_active":"2023-09-28T00:23:54.532040+0000","last_peered":"2023-09-28T00:23:54.532040+0000","last_clean":"2023-09-28T00:23:54.532040+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:23:54.532040+0000","last_undegraded":"2023-09-28T00:23:54.532040+0000","last_fullsized":"2023-09-28T00:23:54.532040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.531885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.531885+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.531885+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:24:57.187820+0000","scrub_duration":0.0020695090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.500911+0000","last_change":"2023-09-28T00:23:40.500873+0000","last_active":"2023-09-28T00:23:40.500911+0000","last_peered":"2023-09-28T00:23:40.500911+0000","last_clean":"2023-09-28T00:23:40.500911+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:23:40.500911+0000","last_undegraded":"2023-09-28T00:23:40.500911+0000","last_fullsized":"2023-09-28T00:23:40.500911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.500773+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:13.242345+0000","scrub_duration":0.00202352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.081270+0000","last_change":"2023-09-28T00:23:54.081238+0000","last_active":"2023-09-28T00:23:54.081270+0000","last_peered":"2023-09-28T00:23:54.081270+0000","last_clean":"2023-09-28T00:23:54.081270+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:23:54.081270+0000","last_undegraded":"2023-09-28T00:23:54.081270+0000","last_fullsized":"2023-09-28T00:23:54.081270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.081099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.081099+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.081099+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:23:24.004765+0000","scrub_duration":0.0015460300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:07.218625+0000","last_change":"2023-09-28T00:24:07.218574+0000","last_active":"2023-09-28T00:24:07.218625+0000","last_peered":"2023-09-28T00:24:07.218625+0000","last_clean":"2023-09-28T00:24:07.218625+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:24:07.218625+0000","last_undegraded":"2023-09-28T00:24:07.218625+0000","last_fullsized":"2023-09-28T00:24:07.218625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:07.218472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:07.218472+0000","last_clean_scrub_stamp":"2023-09-28T00:24:07.218472+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:58.072255+0000","scrub_duration":0.0014751230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.489676+0000","last_change":"2023-09-28T00:24:01.489645+0000","last_active":"2023-09-28T00:24:01.489676+0000","last_peered":"2023-09-28T00:24:01.489676+0000","last_clean":"2023-09-28T00:24:01.489676+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:24:01.489676+0000","last_undegraded":"2023-09-28T00:24:01.489676+0000","last_fullsized":"2023-09-28T00:24:01.489676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.489544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.489544+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.489544+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:15.174049+0000","scrub_duration":0.0018905860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:55.047512+0000","last_change":"2023-09-28T00:23:55.047480+0000","last_active":"2023-09-28T00:23:55.047512+0000","last_peered":"2023-09-28T00:23:55.047512+0000","last_clean":"2023-09-28T00:23:55.047512+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:23:55.047512+0000","last_undegraded":"2023-09-28T00:23:55.047512+0000","last_fullsized":"2023-09-28T00:23:55.047512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:55.047351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:55.047351+0000","last_clean_scrub_stamp":"2023-09-28T00:23:55.047351+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:11.971643+0000","scrub_duration":0.0020499580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.945781+0000","last_change":"2023-09-28T00:23:45.945752+0000","last_active":"2023-09-28T00:23:45.945781+0000","last_peered":"2023-09-28T00:23:45.945781+0000","last_clean":"2023-09-28T00:23:45.945781+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:23:45.945781+0000","last_undegraded":"2023-09-28T00:23:45.945781+0000","last_fullsized":"2023-09-28T00:23:45.945781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.945643+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:22.905557+0000","scrub_duration":0.0014949780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189175+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:23:02.189175+0000","last_peered":"2023-09-28T00:23:02.189175+0000","last_clean":"2023-09-28T00:23:02.189175+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:23:02.189175+0000","last_undegraded":"2023-09-28T00:23:02.189175+0000","last_fullsized":"2023-09-28T00:23:02.189175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.589615+0000","last_change":"2023-09-28T00:23:34.589582+0000","last_active":"2023-09-28T00:23:34.589615+0000","last_peered":"2023-09-28T00:23:34.589615+0000","last_clean":"2023-09-28T00:23:34.589615+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:34.589615+0000","last_undegraded":"2023-09-28T00:23:34.589615+0000","last_fullsized":"2023-09-28T00:23:34.589615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.589490+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:12:13.514087+0000","scrub_duration":0.0039604139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.983259+0000","last_change":"2023-09-28T00:23:39.983230+0000","last_active":"2023-09-28T00:23:39.983259+0000","last_peered":"2023-09-28T00:23:39.983259+0000","last_clean":"2023-09-28T00:23:39.983259+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:23:39.983259+0000","last_undegraded":"2023-09-28T00:23:39.983259+0000","last_fullsized":"2023-09-28T00:23:39.983259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.983114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:31.406543+0000","scrub_duration":0.0015432110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.110943+0000","last_change":"2023-09-28T00:23:36.110868+0000","last_active":"2023-09-28T00:23:36.110943+0000","last_peered":"2023-09-28T00:23:36.110943+0000","last_clean":"2023-09-28T00:23:36.110943+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:36.110943+0000","last_undegraded":"2023-09-28T00:23:36.110943+0000","last_fullsized":"2023-09-28T00:23:36.110943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.110764+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:13.070678+0000","scrub_duration":0.0050075609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:59.153801+0000","last_change":"2023-09-28T00:23:59.153774+0000","last_active":"2023-09-28T00:23:59.153801+0000","last_peered":"2023-09-28T00:23:59.153801+0000","last_clean":"2023-09-28T00:23:59.153801+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:23:59.153801+0000","last_undegraded":"2023-09-28T00:23:59.153801+0000","last_fullsized":"2023-09-28T00:23:59.153801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:59.153647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:59.153647+0000","last_clean_scrub_stamp":"2023-09-28T00:23:59.153647+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:19.833384+0000","scrub_duration":0.0020011970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.413348+0000","last_change":"2023-09-28T00:23:38.413300+0000","last_active":"2023-09-28T00:23:38.413348+0000","last_peered":"2023-09-28T00:23:38.413348+0000","last_clean":"2023-09-28T00:23:38.413348+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:38.413348+0000","last_undegraded":"2023-09-28T00:23:38.413348+0000","last_fullsized":"2023-09-28T00:23:38.413348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.413180+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:20.986223+0000","scrub_duration":0.0028226290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189135+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:23:02.189135+0000","last_peered":"2023-09-28T00:23:02.189135+0000","last_clean":"2023-09-28T00:23:02.189135+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:23:02.189135+0000","last_undegraded":"2023-09-28T00:23:02.189135+0000","last_fullsized":"2023-09-28T00:23:02.189135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.399962+0000","last_change":"2023-09-28T00:23:37.399912+0000","last_active":"2023-09-28T00:23:37.399962+0000","last_peered":"2023-09-28T00:23:37.399962+0000","last_clean":"2023-09-28T00:23:37.399962+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:37.399962+0000","last_undegraded":"2023-09-28T00:23:37.399962+0000","last_fullsized":"2023-09-28T00:23:37.399962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.399783+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:14.359696+0000","scrub_duration":0.0050903859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:59.149371+0000","last_change":"2023-09-28T00:23:59.149341+0000","last_active":"2023-09-28T00:23:59.149371+0000","last_peered":"2023-09-28T00:23:59.149371+0000","last_clean":"2023-09-28T00:23:59.149371+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:23:59.149371+0000","last_undegraded":"2023-09-28T00:23:59.149371+0000","last_fullsized":"2023-09-28T00:23:59.149371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:59.149222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:59.149222+0000","last_clean_scrub_stamp":"2023-09-28T00:23:59.149222+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:46.495997+0000","scrub_duration":0.0022240350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.362266+0000","last_change":"2023-09-28T00:23:32.362236+0000","last_active":"2023-09-28T00:23:32.362266+0000","last_peered":"2023-09-28T00:23:32.362266+0000","last_clean":"2023-09-28T00:23:32.362266+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:32.362266+0000","last_undegraded":"2023-09-28T00:23:32.362266+0000","last_fullsized":"2023-09-28T00:23:32.362266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.362132+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:11:43.475524+0000","scrub_duration":0.001706475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188752+0000","last_change":"2023-09-28T00:22:59.708720+0000","last_active":"2023-09-28T00:23:02.188752+0000","last_peered":"2023-09-28T00:23:02.188752+0000","last_clean":"2023-09-28T00:23:02.188752+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:23:02.188752+0000","last_undegraded":"2023-09-28T00:23:02.188752+0000","last_fullsized":"2023-09-28T00:23:02.188752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.294191+0000","last_change":"2023-09-28T00:23:32.294167+0000","last_active":"2023-09-28T00:23:32.294191+0000","last_peered":"2023-09-28T00:23:32.294191+0000","last_clean":"2023-09-28T00:23:32.294191+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:32.294191+0000","last_undegraded":"2023-09-28T00:23:32.294191+0000","last_fullsized":"2023-09-28T00:23:32.294191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.294091+0000","objects_scrubbed":4,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:06.602627+0000","scrub_duration":0.003875613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.214625+0000","last_change":"2023-09-28T00:24:06.214576+0000","last_active":"2023-09-28T00:24:06.214625+0000","last_peered":"2023-09-28T00:24:06.214625+0000","last_clean":"2023-09-28T00:24:06.214625+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:24:06.214625+0000","last_undegraded":"2023-09-28T00:24:06.214625+0000","last_fullsized":"2023-09-28T00:24:06.214625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.214452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.214452+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.214452+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:13:58.953783+0000","scrub_duration":0.0019508920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.728916+0000","last_change":"2023-09-28T00:22:59.204516+0000","last_active":"2023-09-28T00:23:05.728916+0000","last_peered":"2023-09-28T00:23:05.728916+0000","last_clean":"2023-09-28T00:23:05.728916+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:23:05.728916+0000","last_undegraded":"2023-09-28T00:23:05.728916+0000","last_fullsized":"2023-09-28T00:23:05.728916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.416914+0000","last_change":"2023-09-28T00:23:34.416862+0000","last_active":"2023-09-28T00:23:34.416914+0000","last_peered":"2023-09-28T00:23:34.416914+0000","last_clean":"2023-09-28T00:23:34.416914+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:23:34.416914+0000","last_undegraded":"2023-09-28T00:23:34.416914+0000","last_fullsized":"2023-09-28T00:23:34.416914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.416729+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:46.450761+0000","scrub_duration":0.0016463960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'15","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:08.904884+0000","last_change":"2023-09-28T00:24:08.904837+0000","last_active":"2023-09-28T00:24:08.904884+0000","last_peered":"2023-09-28T00:24:08.904884+0000","last_clean":"2023-09-28T00:24:08.904884+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:24:08.904884+0000","last_undegraded":"2023-09-28T00:24:08.904884+0000","last_fullsized":"2023-09-28T00:24:08.904884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2023-09-28T00:24:08.904723+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2023-09-28T00:24:08.904723+0000","last_clean_scrub_stamp":"2023-09-28T00:24:08.904723+0000","objects_scrubbed":6,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:35.916715+0000","scrub_duration":0.0063761390000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.044593+0000","last_change":"2023-09-28T00:24:00.044566+0000","last_active":"2023-09-28T00:24:00.044593+0000","last_peered":"2023-09-28T00:24:00.044593+0000","last_clean":"2023-09-28T00:24:00.044593+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:24:00.044593+0000","last_undegraded":"2023-09-28T00:24:00.044593+0000","last_fullsized":"2023-09-28T00:24:00.044593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.044450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.044450+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.044450+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:27:05.463992+0000","scrub_duration":0.001578772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.143134+0000","last_change":"2023-09-28T00:23:35.143103+0000","last_active":"2023-09-28T00:23:35.143134+0000","last_peered":"2023-09-28T00:23:35.143134+0000","last_clean":"2023-09-28T00:23:35.143134+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:35.143134+0000","last_undegraded":"2023-09-28T00:23:35.143134+0000","last_fullsized":"2023-09-28T00:23:35.143134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.143009+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:22.819982+0000","scrub_duration":0.0043366630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.077248+0000","last_change":"2023-09-28T00:23:44.077215+0000","last_active":"2023-09-28T00:23:44.077248+0000","last_peered":"2023-09-28T00:23:44.077248+0000","last_clean":"2023-09-28T00:23:44.077248+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:23:44.077248+0000","last_undegraded":"2023-09-28T00:23:44.077248+0000","last_fullsized":"2023-09-28T00:23:44.077248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.077114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:31.423889+0000","scrub_duration":0.0016410789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.134927+0000","last_change":"2023-09-28T00:23:39.134889+0000","last_active":"2023-09-28T00:23:39.134927+0000","last_peered":"2023-09-28T00:23:39.134927+0000","last_clean":"2023-09-28T00:23:39.134927+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:39.134927+0000","last_undegraded":"2023-09-28T00:23:39.134927+0000","last_fullsized":"2023-09-28T00:23:39.134927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.134801+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:08.531014+0000","scrub_duration":0.0043778289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:00.691779+0000","last_change":"2023-09-28T00:22:59.706405+0000","last_active":"2023-09-28T00:23:00.691779+0000","last_peered":"2023-09-28T00:23:00.691779+0000","last_clean":"2023-09-28T00:23:00.691779+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:23:00.691779+0000","last_undegraded":"2023-09-28T00:23:00.691779+0000","last_fullsized":"2023-09-28T00:23:00.691779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'21","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.575210+0000","last_change":"2023-09-28T00:23:32.575182+0000","last_active":"2023-09-28T00:23:32.575210+0000","last_peered":"2023-09-28T00:23:32.575210+0000","last_clean":"2023-09-28T00:23:32.575210+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:32.575210+0000","last_undegraded":"2023-09-28T00:23:32.575210+0000","last_fullsized":"2023-09-28T00:23:32.575210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.575111+0000","objects_scrubbed":8,"log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:28.818017+0000","scrub_duration":0.004538523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:08.543302+0000","last_change":"2023-09-28T00:24:08.543272+0000","last_active":"2023-09-28T00:24:08.543302+0000","last_peered":"2023-09-28T00:24:08.543302+0000","last_clean":"2023-09-28T00:24:08.543302+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:24:08.543302+0000","last_undegraded":"2023-09-28T00:24:08.543302+0000","last_fullsized":"2023-09-28T00:24:08.543302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:08.543160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:08.543160+0000","last_clean_scrub_stamp":"2023-09-28T00:24:08.543160+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:59.396943+0000","scrub_duration":0.0022213440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.319409+0000","last_change":"2023-09-28T00:23:29.319382+0000","last_active":"2023-09-28T00:23:29.319409+0000","last_peered":"2023-09-28T00:23:29.319409+0000","last_clean":"2023-09-28T00:23:29.319409+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:29.319409+0000","last_undegraded":"2023-09-28T00:23:29.319409+0000","last_fullsized":"2023-09-28T00:23:29.319409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.319298+0000","objects_scrubbed":2,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:16:37.432115+0000","scrub_duration":0.002326229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188365+0000","last_change":"2023-09-28T00:22:59.707203+0000","last_active":"2023-09-28T00:23:02.188365+0000","last_peered":"2023-09-28T00:23:02.188365+0000","last_clean":"2023-09-28T00:23:02.188365+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:23:02.188365+0000","last_undegraded":"2023-09-28T00:23:02.188365+0000","last_fullsized":"2023-09-28T00:23:02.188365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.400420+0000","last_change":"2023-09-28T00:23:33.400388+0000","last_active":"2023-09-28T00:23:33.400420+0000","last_peered":"2023-09-28T00:23:33.400420+0000","last_clean":"2023-09-28T00:23:33.400420+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:33.400420+0000","last_undegraded":"2023-09-28T00:23:33.400420+0000","last_fullsized":"2023-09-28T00:23:33.400420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.400290+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:16:32.293022+0000","scrub_duration":0.0031017280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.549752+0000","last_change":"2023-09-28T00:23:38.549684+0000","last_active":"2023-09-28T00:23:38.549752+0000","last_peered":"2023-09-28T00:23:38.549752+0000","last_clean":"2023-09-28T00:23:38.549752+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:23:38.549752+0000","last_undegraded":"2023-09-28T00:23:38.549752+0000","last_fullsized":"2023-09-28T00:23:38.549752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.549532+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:38:59.086311+0000","scrub_duration":0.0020537279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.127159+0000","last_change":"2023-09-28T00:23:30.127112+0000","last_active":"2023-09-28T00:23:30.127159+0000","last_peered":"2023-09-28T00:23:30.127159+0000","last_clean":"2023-09-28T00:23:30.127159+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:30.127159+0000","last_undegraded":"2023-09-28T00:23:30.127159+0000","last_fullsized":"2023-09-28T00:23:30.127159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.127030+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:58.393189+0000","scrub_duration":0.00305843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.345983+0000","last_change":"2023-09-28T00:23:43.345944+0000","last_active":"2023-09-28T00:23:43.345983+0000","last_peered":"2023-09-28T00:23:43.345983+0000","last_clean":"2023-09-28T00:23:43.345983+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:23:43.345983+0000","last_undegraded":"2023-09-28T00:23:43.345983+0000","last_fullsized":"2023-09-28T00:23:43.345983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.345844+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:16.087415+0000","scrub_duration":0.0015894629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.278071+0000","last_change":"2023-09-28T00:23:33.278024+0000","last_active":"2023-09-28T00:23:33.278071+0000","last_peered":"2023-09-28T00:23:33.278071+0000","last_clean":"2023-09-28T00:23:33.278071+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:33.278071+0000","last_undegraded":"2023-09-28T00:23:33.278071+0000","last_fullsized":"2023-09-28T00:23:33.278071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.277933+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:20.954905+0000","scrub_duration":0.0026154009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:53.434646+0000","last_change":"2023-09-28T00:23:53.434610+0000","last_active":"2023-09-28T00:23:53.434646+0000","last_peered":"2023-09-28T00:23:53.434646+0000","last_clean":"2023-09-28T00:23:53.434646+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:23:53.434646+0000","last_undegraded":"2023-09-28T00:23:53.434646+0000","last_fullsized":"2023-09-28T00:23:53.434646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:53.434474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:53.434474+0000","last_clean_scrub_stamp":"2023-09-28T00:23:53.434474+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:58.854016+0000","scrub_duration":0.0017684179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.958082+0000","last_change":"2023-09-28T00:23:36.958043+0000","last_active":"2023-09-28T00:23:36.958082+0000","last_peered":"2023-09-28T00:23:36.958082+0000","last_clean":"2023-09-28T00:23:36.958082+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:36.958082+0000","last_undegraded":"2023-09-28T00:23:36.958082+0000","last_fullsized":"2023-09-28T00:23:36.958082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.957909+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:24.634881+0000","scrub_duration":0.0032571900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.135317+0000","last_change":"2023-09-28T00:23:42.135283+0000","last_active":"2023-09-28T00:23:42.135317+0000","last_peered":"2023-09-28T00:23:42.135317+0000","last_clean":"2023-09-28T00:23:42.135317+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:23:42.135317+0000","last_undegraded":"2023-09-28T00:23:42.135317+0000","last_fullsized":"2023-09-28T00:23:42.135317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.135184+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:19.095098+0000","scrub_duration":0.001635837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.120381+0000","last_change":"2023-09-28T00:23:47.120329+0000","last_active":"2023-09-28T00:23:47.120381+0000","last_peered":"2023-09-28T00:23:47.120381+0000","last_clean":"2023-09-28T00:23:47.120381+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:47.120381+0000","last_undegraded":"2023-09-28T00:23:47.120381+0000","last_fullsized":"2023-09-28T00:23:47.120381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.120219+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:52.539761+0000","scrub_duration":0.0039619049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189360+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:23:02.189360+0000","last_peered":"2023-09-28T00:23:02.189360+0000","last_clean":"2023-09-28T00:23:02.189360+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:23:02.189360+0000","last_undegraded":"2023-09-28T00:23:02.189360+0000","last_fullsized":"2023-09-28T00:23:02.189360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'7","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:05.725949+0000","last_change":"2023-09-28T00:22:59.204649+0000","last_active":"2023-09-28T00:23:05.725949+0000","last_peered":"2023-09-28T00:23:05.725949+0000","last_clean":"2023-09-28T00:23:05.725949+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:23:05.725949+0000","last_undegraded":"2023-09-28T00:23:05.725949+0000","last_fullsized":"2023-09-28T00:23:05.725949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:58.177079+0000","last_clean_scrub_stamp":"2023-09-28T00:22:58.177079+0000","objects_scrubbed":0,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.299579+0000","last_change":"2023-09-28T00:23:56.299517+0000","last_active":"2023-09-28T00:23:56.299579+0000","last_peered":"2023-09-28T00:23:56.299579+0000","last_clean":"2023-09-28T00:23:56.299579+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:23:56.299579+0000","last_undegraded":"2023-09-28T00:23:56.299579+0000","last_fullsized":"2023-09-28T00:23:56.299579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.299388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.299388+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.299388+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:57.055926+0000","scrub_duration":0.0017635509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.085810+0000","last_change":"2023-09-28T00:23:35.085780+0000","last_active":"2023-09-28T00:23:35.085810+0000","last_peered":"2023-09-28T00:23:35.085810+0000","last_clean":"2023-09-28T00:23:35.085810+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:35.085810+0000","last_undegraded":"2023-09-28T00:23:35.085810+0000","last_fullsized":"2023-09-28T00:23:35.085810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.085669+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:37.538489+0000","scrub_duration":0.0028376410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.992118+0000","last_change":"2023-09-28T00:23:47.992070+0000","last_active":"2023-09-28T00:23:47.992118+0000","last_peered":"2023-09-28T00:23:47.992118+0000","last_clean":"2023-09-28T00:23:47.992118+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:23:47.992118+0000","last_undegraded":"2023-09-28T00:23:47.992118+0000","last_fullsized":"2023-09-28T00:23:47.992118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.991945+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:27.276590+0000","scrub_duration":0.0016691169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.390807+0000","last_change":"2023-09-28T00:23:32.390774+0000","last_active":"2023-09-28T00:23:32.390807+0000","last_peered":"2023-09-28T00:23:32.390807+0000","last_clean":"2023-09-28T00:23:32.390807+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:23:32.390807+0000","last_undegraded":"2023-09-28T00:23:32.390807+0000","last_fullsized":"2023-09-28T00:23:32.390807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.390659+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:23.814089+0000","scrub_duration":0.001476237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.350385+0000","last_change":"2023-09-28T00:23:29.350352+0000","last_active":"2023-09-28T00:23:29.350385+0000","last_peered":"2023-09-28T00:23:29.350385+0000","last_clean":"2023-09-28T00:23:29.350385+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:29.350385+0000","last_undegraded":"2023-09-28T00:23:29.350385+0000","last_fullsized":"2023-09-28T00:23:29.350385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.350273+0000","objects_scrubbed":3,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:06:24.282255+0000","scrub_duration":0.0024491669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:52.068310+0000","last_change":"2023-09-28T00:23:52.068250+0000","last_active":"2023-09-28T00:23:52.068310+0000","last_peered":"2023-09-28T00:23:52.068310+0000","last_clean":"2023-09-28T00:23:52.068310+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:23:52.068310+0000","last_undegraded":"2023-09-28T00:23:52.068310+0000","last_fullsized":"2023-09-28T00:23:52.068310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:52.068117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:52.068117+0000","last_clean_scrub_stamp":"2023-09-28T00:23:52.068117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:23:21.991783+0000","scrub_duration":0.001925312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.901921+0000","last_change":"2023-09-28T00:24:06.901889+0000","last_active":"2023-09-28T00:24:06.901921+0000","last_peered":"2023-09-28T00:24:06.901921+0000","last_clean":"2023-09-28T00:24:06.901921+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:24:06.901921+0000","last_undegraded":"2023-09-28T00:24:06.901921+0000","last_fullsized":"2023-09-28T00:24:06.901921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.901757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.901757+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.901757+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:16.989478+0000","scrub_duration":0.002189018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.293946+0000","last_change":"2023-09-28T00:23:30.293921+0000","last_active":"2023-09-28T00:23:30.293946+0000","last_peered":"2023-09-28T00:23:30.293946+0000","last_clean":"2023-09-28T00:23:30.293946+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:30.293946+0000","last_undegraded":"2023-09-28T00:23:30.293946+0000","last_fullsized":"2023-09-28T00:23:30.293946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.293841+0000","objects_scrubbed":5,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:23.134625+0000","scrub_duration":0.002485498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.095642+0000","last_change":"2023-09-28T00:23:46.095610+0000","last_active":"2023-09-28T00:23:46.095642+0000","last_peered":"2023-09-28T00:23:46.095642+0000","last_clean":"2023-09-28T00:23:46.095642+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:23:46.095642+0000","last_undegraded":"2023-09-28T00:23:46.095642+0000","last_fullsized":"2023-09-28T00:23:46.095642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.095492+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:25.380137+0000","scrub_duration":0.0014021330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.956906+0000","last_change":"2023-09-28T00:23:35.956877+0000","last_active":"2023-09-28T00:23:35.956906+0000","last_peered":"2023-09-28T00:23:35.956906+0000","last_clean":"2023-09-28T00:23:35.956906+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:23:35.956906+0000","last_undegraded":"2023-09-28T00:23:35.956906+0000","last_fullsized":"2023-09-28T00:23:35.956906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.956762+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:10.265298+0000","scrub_duration":0.00159213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.385146+0000","last_change":"2023-09-28T00:23:35.385107+0000","last_active":"2023-09-28T00:23:35.385146+0000","last_peered":"2023-09-28T00:23:35.385146+0000","last_clean":"2023-09-28T00:23:35.385146+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:35.385146+0000","last_undegraded":"2023-09-28T00:23:35.385146+0000","last_fullsized":"2023-09-28T00:23:35.385146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.384999+0000","objects_scrubbed":1,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:56.683879+0000","scrub_duration":0.003022407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.111930+0000","last_change":"2023-09-28T00:23:44.111895+0000","last_active":"2023-09-28T00:23:44.111930+0000","last_peered":"2023-09-28T00:23:44.111930+0000","last_clean":"2023-09-28T00:23:44.111930+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:23:44.111930+0000","last_undegraded":"2023-09-28T00:23:44.111930+0000","last_fullsized":"2023-09-28T00:23:44.111930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.111778+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:21.071692+0000","scrub_duration":0.0020723899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.126803+0000","last_change":"2023-09-28T00:23:54.126756+0000","last_active":"2023-09-28T00:23:54.126803+0000","last_peered":"2023-09-28T00:23:54.126803+0000","last_clean":"2023-09-28T00:23:54.126803+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:23:54.126803+0000","last_undegraded":"2023-09-28T00:23:54.126803+0000","last_fullsized":"2023-09-28T00:23:54.126803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.126652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.126652+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.126652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:14.806389+0000","scrub_duration":0.0016744850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.534399+0000","last_change":"2023-09-28T00:23:31.534372+0000","last_active":"2023-09-28T00:23:31.534399+0000","last_peered":"2023-09-28T00:23:31.534399+0000","last_clean":"2023-09-28T00:23:31.534399+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:23:31.534399+0000","last_undegraded":"2023-09-28T00:23:31.534399+0000","last_fullsized":"2023-09-28T00:23:31.534399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.534296+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:08:14.007270+0000","scrub_duration":0.0047438030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.142763+0000","last_change":"2023-09-28T00:23:37.142735+0000","last_active":"2023-09-28T00:23:37.142763+0000","last_peered":"2023-09-28T00:23:37.142763+0000","last_clean":"2023-09-28T00:23:37.142763+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:37.142763+0000","last_undegraded":"2023-09-28T00:23:37.142763+0000","last_fullsized":"2023-09-28T00:23:37.142763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.142635+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:19.715678+0000","scrub_duration":0.0044461099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189335+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:23:02.189335+0000","last_peered":"2023-09-28T00:23:02.189335+0000","last_clean":"2023-09-28T00:23:02.189335+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:23:02.189335+0000","last_undegraded":"2023-09-28T00:23:02.189335+0000","last_fullsized":"2023-09-28T00:23:02.189335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.989229+0000","last_change":"2023-09-28T00:24:01.989195+0000","last_active":"2023-09-28T00:24:01.989229+0000","last_peered":"2023-09-28T00:24:01.989229+0000","last_clean":"2023-09-28T00:24:01.989229+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:24:01.989229+0000","last_undegraded":"2023-09-28T00:24:01.989229+0000","last_fullsized":"2023-09-28T00:24:01.989229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.989085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.989085+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.989085+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:52.842868+0000","scrub_duration":0.0023898869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.146002+0000","last_change":"2023-09-28T00:23:32.145963+0000","last_active":"2023-09-28T00:23:32.146002+0000","last_peered":"2023-09-28T00:23:32.146002+0000","last_clean":"2023-09-28T00:23:32.146002+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:32.146002+0000","last_undegraded":"2023-09-28T00:23:32.146002+0000","last_fullsized":"2023-09-28T00:23:32.146002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.145842+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:24.986625+0000","scrub_duration":0.0025902830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.442472+0000","last_change":"2023-09-28T00:23:46.442444+0000","last_active":"2023-09-28T00:23:46.442472+0000","last_peered":"2023-09-28T00:23:46.442472+0000","last_clean":"2023-09-28T00:23:46.442472+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:23:46.442472+0000","last_undegraded":"2023-09-28T00:23:46.442472+0000","last_fullsized":"2023-09-28T00:23:46.442472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.442331+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:15.838545+0000","scrub_duration":0.0013918260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:50.123742+0000","last_change":"2023-09-28T00:23:50.123709+0000","last_active":"2023-09-28T00:23:50.123742+0000","last_peered":"2023-09-28T00:23:50.123742+0000","last_clean":"2023-09-28T00:23:50.123742+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:23:50.123742+0000","last_undegraded":"2023-09-28T00:23:50.123742+0000","last_fullsized":"2023-09-28T00:23:50.123742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:50.123604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:50.123604+0000","last_clean_scrub_stamp":"2023-09-28T00:23:50.123604+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:07.047896+0000","scrub_duration":0.0020728830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.160690+0000","last_change":"2023-09-28T00:23:38.160661+0000","last_active":"2023-09-28T00:23:38.160690+0000","last_peered":"2023-09-28T00:23:38.160690+0000","last_clean":"2023-09-28T00:23:38.160690+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:38.160690+0000","last_undegraded":"2023-09-28T00:23:38.160690+0000","last_fullsized":"2023-09-28T00:23:38.160690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.160543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:29.583972+0000","scrub_duration":0.0015551149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.149982+0000","last_change":"2023-09-28T00:23:43.149946+0000","last_active":"2023-09-28T00:23:43.149982+0000","last_peered":"2023-09-28T00:23:43.149982+0000","last_clean":"2023-09-28T00:23:43.149982+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:23:43.149982+0000","last_undegraded":"2023-09-28T00:23:43.149982+0000","last_fullsized":"2023-09-28T00:23:43.149982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.149846+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:45.602666+0000","scrub_duration":0.0019646730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'11","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.073095+0000","last_change":"2023-09-28T00:23:45.073062+0000","last_active":"2023-09-28T00:23:45.073095+0000","last_peered":"2023-09-28T00:23:45.073095+0000","last_clean":"2023-09-28T00:23:45.073095+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:45.073095+0000","last_undegraded":"2023-09-28T00:23:45.073095+0000","last_fullsized":"2023-09-28T00:23:45.073095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.072959+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:14.469172+0000","scrub_duration":0.0043027669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.049288+0000","last_change":"2023-09-28T00:23:31.049243+0000","last_active":"2023-09-28T00:23:31.049288+0000","last_peered":"2023-09-28T00:23:31.049288+0000","last_clean":"2023-09-28T00:23:31.049288+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:23:31.049288+0000","last_undegraded":"2023-09-28T00:23:31.049288+0000","last_fullsized":"2023-09-28T00:23:31.049288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.049126+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:22.472556+0000","scrub_duration":0.0016726429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188822+0000","last_change":"2023-09-28T00:22:59.722051+0000","last_active":"2023-09-28T00:23:02.188822+0000","last_peered":"2023-09-28T00:23:02.188822+0000","last_clean":"2023-09-28T00:23:02.188822+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:23:02.188822+0000","last_undegraded":"2023-09-28T00:23:02.188822+0000","last_fullsized":"2023-09-28T00:23:02.188822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.025569+0000","last_change":"2023-09-28T00:24:01.025536+0000","last_active":"2023-09-28T00:24:01.025569+0000","last_peered":"2023-09-28T00:24:01.025569+0000","last_clean":"2023-09-28T00:24:01.025569+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:24:01.025569+0000","last_undegraded":"2023-09-28T00:24:01.025569+0000","last_fullsized":"2023-09-28T00:24:01.025569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.025433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.025433+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.025433+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:13:53.764764+0000","scrub_duration":0.0016622360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.084444+0000","last_change":"2023-09-28T00:23:34.084410+0000","last_active":"2023-09-28T00:23:34.084444+0000","last_peered":"2023-09-28T00:23:34.084444+0000","last_clean":"2023-09-28T00:23:34.084444+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:34.084444+0000","last_undegraded":"2023-09-28T00:23:34.084444+0000","last_fullsized":"2023-09-28T00:23:34.084444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.084301+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:55.383181+0000","scrub_duration":0.003197971,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.323131+0000","last_change":"2023-09-28T00:23:42.323097+0000","last_active":"2023-09-28T00:23:42.323131+0000","last_peered":"2023-09-28T00:23:42.323131+0000","last_clean":"2023-09-28T00:23:42.323131+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:23:42.323131+0000","last_undegraded":"2023-09-28T00:23:42.323131+0000","last_fullsized":"2023-09-28T00:23:42.323131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.322988+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:38.153260+0000","scrub_duration":0.0016894810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.081883+0000","last_change":"2023-09-28T00:23:39.081826+0000","last_active":"2023-09-28T00:23:39.081883+0000","last_peered":"2023-09-28T00:23:39.081883+0000","last_clean":"2023-09-28T00:23:39.081883+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:39.081883+0000","last_undegraded":"2023-09-28T00:23:39.081883+0000","last_fullsized":"2023-09-28T00:23:39.081883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.081717+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:03.473134+0000","scrub_duration":0.0047997099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:52.019821+0000","last_change":"2023-09-28T00:23:52.019791+0000","last_active":"2023-09-28T00:23:52.019821+0000","last_peered":"2023-09-28T00:23:52.019821+0000","last_clean":"2023-09-28T00:23:52.019821+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:23:52.019821+0000","last_undegraded":"2023-09-28T00:23:52.019821+0000","last_fullsized":"2023-09-28T00:23:52.019821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:52.019665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:52.019665+0000","last_clean_scrub_stamp":"2023-09-28T00:23:52.019665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:57.439207+0000","scrub_duration":0.001523052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.608016+0000","last_change":"2023-09-28T00:23:33.607964+0000","last_active":"2023-09-28T00:23:33.608016+0000","last_peered":"2023-09-28T00:23:33.608016+0000","last_clean":"2023-09-28T00:23:33.608016+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:33.608016+0000","last_undegraded":"2023-09-28T00:23:33.608016+0000","last_fullsized":"2023-09-28T00:23:33.608016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.607850+0000","objects_scrubbed":3,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:45.641882+0000","scrub_duration":0.003579807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.287201+0000","last_change":"2023-09-28T00:24:00.287167+0000","last_active":"2023-09-28T00:24:00.287201+0000","last_peered":"2023-09-28T00:24:00.287201+0000","last_clean":"2023-09-28T00:24:00.287201+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:24:00.287201+0000","last_undegraded":"2023-09-28T00:24:00.287201+0000","last_fullsized":"2023-09-28T00:24:00.287201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.287064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.287064+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.287064+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:44:09.090387+0000","scrub_duration":0.0020295830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'13","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.069809+0000","last_change":"2023-09-28T00:23:33.069768+0000","last_active":"2023-09-28T00:23:33.069809+0000","last_peered":"2023-09-28T00:23:33.069809+0000","last_clean":"2023-09-28T00:23:33.069809+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:33.069809+0000","last_undegraded":"2023-09-28T00:23:33.069809+0000","last_fullsized":"2023-09-28T00:23:33.069809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.069686+0000","objects_scrubbed":7,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:12.354331+0000","scrub_duration":0.0030685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:57.292546+0000","last_change":"2023-09-28T00:23:57.292511+0000","last_active":"2023-09-28T00:23:57.292546+0000","last_peered":"2023-09-28T00:23:57.292546+0000","last_clean":"2023-09-28T00:23:57.292546+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:23:57.292546+0000","last_undegraded":"2023-09-28T00:23:57.292546+0000","last_fullsized":"2023-09-28T00:23:57.292546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:57.292416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:57.292416+0000","last_clean_scrub_stamp":"2023-09-28T00:23:57.292416+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:24:59.948351+0000","scrub_duration":0.002143608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.390499+0000","last_change":"2023-09-28T00:23:36.390460+0000","last_active":"2023-09-28T00:23:36.390499+0000","last_peered":"2023-09-28T00:23:36.390499+0000","last_clean":"2023-09-28T00:23:36.390499+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:36.390499+0000","last_undegraded":"2023-09-28T00:23:36.390499+0000","last_fullsized":"2023-09-28T00:23:36.390499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.390358+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:38.843177+0000","scrub_duration":0.002166659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.911467+0000","last_change":"2023-09-28T00:23:44.911437+0000","last_active":"2023-09-28T00:23:44.911467+0000","last_peered":"2023-09-28T00:23:44.911467+0000","last_clean":"2023-09-28T00:23:44.911467+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:23:44.911467+0000","last_undegraded":"2023-09-28T00:23:44.911467+0000","last_fullsized":"2023-09-28T00:23:44.911467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.911323+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:47.364143+0000","scrub_duration":0.001669542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'19","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.462441+0000","last_change":"2023-09-28T00:23:40.462404+0000","last_active":"2023-09-28T00:23:40.462441+0000","last_peered":"2023-09-28T00:23:40.462441+0000","last_clean":"2023-09-28T00:23:40.462441+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:40.462441+0000","last_undegraded":"2023-09-28T00:23:40.462441+0000","last_fullsized":"2023-09-28T00:23:40.462441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.462229+0000","objects_scrubbed":6,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:04.853646+0000","scrub_duration":0.0064632149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.416065+0000","last_change":"2023-09-28T00:23:47.416035+0000","last_active":"2023-09-28T00:23:47.416065+0000","last_peered":"2023-09-28T00:23:47.416065+0000","last_clean":"2023-09-28T00:23:47.416065+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:23:47.416065+0000","last_undegraded":"2023-09-28T00:23:47.416065+0000","last_fullsized":"2023-09-28T00:23:47.416065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.415939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:46.034885+0000","scrub_duration":0.001829188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:57.495699+0000","last_change":"2023-09-28T00:23:57.495668+0000","last_active":"2023-09-28T00:23:57.495699+0000","last_peered":"2023-09-28T00:23:57.495699+0000","last_clean":"2023-09-28T00:23:57.495699+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:23:57.495699+0000","last_undegraded":"2023-09-28T00:23:57.495699+0000","last_fullsized":"2023-09-28T00:23:57.495699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:57.495535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:57.495535+0000","last_clean_scrub_stamp":"2023-09-28T00:23:57.495535+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:44:06.298858+0000","scrub_duration":0.0018793880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.993763+0000","last_change":"2023-09-28T00:23:56.993721+0000","last_active":"2023-09-28T00:23:56.993763+0000","last_peered":"2023-09-28T00:23:56.993763+0000","last_clean":"2023-09-28T00:23:56.993763+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:23:56.993763+0000","last_undegraded":"2023-09-28T00:23:56.993763+0000","last_fullsized":"2023-09-28T00:23:56.993763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.993610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.993610+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.993610+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:44.340385+0000","scrub_duration":0.0017574419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.135639+0000","last_change":"2023-09-28T00:23:40.135600+0000","last_active":"2023-09-28T00:23:40.135639+0000","last_peered":"2023-09-28T00:23:40.135639+0000","last_clean":"2023-09-28T00:23:40.135639+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:23:40.135639+0000","last_undegraded":"2023-09-28T00:23:40.135639+0000","last_fullsized":"2023-09-28T00:23:40.135639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.135470+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:01.434350+0000","scrub_duration":0.0016553480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.483832+0000","last_change":"2023-09-28T00:24:00.483782+0000","last_active":"2023-09-28T00:24:00.483832+0000","last_peered":"2023-09-28T00:24:00.483832+0000","last_clean":"2023-09-28T00:24:00.483832+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:24:00.483832+0000","last_undegraded":"2023-09-28T00:24:00.483832+0000","last_fullsized":"2023-09-28T00:24:00.483832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.483673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.483673+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.483673+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:21.163409+0000","scrub_duration":0.0023254560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:07.544107+0000","last_change":"2023-09-28T00:24:07.544081+0000","last_active":"2023-09-28T00:24:07.544107+0000","last_peered":"2023-09-28T00:24:07.544107+0000","last_clean":"2023-09-28T00:24:07.544107+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:24:07.544107+0000","last_undegraded":"2023-09-28T00:24:07.544107+0000","last_fullsized":"2023-09-28T00:24:07.544107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:07.543963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:07.543963+0000","last_clean_scrub_stamp":"2023-09-28T00:24:07.543963+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:14:00.283294+0000","scrub_duration":0.0018712030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24400,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12272,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359568,"statfs":{"total":96636764160,"available":96624197632,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.78400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13348,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358492,"statfs":{"total":96636764160,"available":96623095808,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.034},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.018}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12336,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359504,"statfs":{"total":96636764160,"available":96624132096,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.755},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.84099999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.442}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.61599999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.375},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.48999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.75}]},{"osd":5,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56200000000000006}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9252,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362588,"statfs":{"total":96636764160,"available":96627290112,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.67200000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:24:13.542 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.543 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.543 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.543 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.544 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.544 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.544 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.544 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.545 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.545 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.545 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.545 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.546 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-28T00:22:58.177079+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=58, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.546 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.546 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:13.547 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:24:29.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:24:29.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:24:33.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:24:33.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.746+0000 7f2896b9d700 1 Processor -- start 2023-09-28T00:24:33.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.746+0000 7f2896b9d700 1 -- start start 2023-09-28T00:24:33.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.747+0000 7f2896b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28900c0e00 0x7f28901595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:33.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.747+0000 7f2896b9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28900c6780 0x7f28900c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:33.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.747+0000 7f2896b9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900c73e0 con 0x7f2890068b40 2023-09-28T00:24:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.747+0000 7f2896b9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900c7c80 con 0x7f28900c6780 2023-09-28T00:24:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.747+0000 7f2896b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2890159af0 con 0x7f28900c0e00 2023-09-28T00:24:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.747+0000 7f289539a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28900c6780 0x7f28900c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28900c6780 0x7f28900c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40360/0 (socket says 172.21.15.53:40360) 2023-09-28T00:24:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 -- 172.21.15.53:0/1229206860 learned_addr learned my addr 172.21.15.53:0/1229206860 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f2895b9b700 1 --2- 172.21.15.53:0/1229206860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28900c0e00 0x7f28901595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 -- 172.21.15.53:0/1229206860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28900c0e00 msgr2=0x7f28901595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 --2- 172.21.15.53:0/1229206860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28900c0e00 0x7f28901595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 -- 172.21.15.53:0/1229206860 >> v1:172.21.15.118:6789/0 conn(0x7f2890068b40 legacy=0x7f289013e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 -- 172.21.15.53:0/1229206860 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890089c00 con 0x7f28900c6780 2023-09-28T00:24:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f2894b99700 1 -- 172.21.15.53:0/1229206860 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902406241 0 0) 0x7f28900c73e0 con 0x7f2890068b40 2023-09-28T00:24:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.748+0000 7f289539a700 1 --2- 172.21.15.53:0/1229206860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c8110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f28800099b0 tx=0x7f2880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d0fef382e0f3e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2894b99700 1 -- 172.21.15.53:0/1229206860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880009ea0 con 0x7f28900c6780 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2894b99700 1 -- 172.21.15.53:0/1229206860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000b8f0 con 0x7f28900c6780 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2894b99700 1 -- 172.21.15.53:0/1229206860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000bc90 con 0x7f28900c6780 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 -- 172.21.15.53:0/1229206860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 msgr2=0x7f28900c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 --2- 172.21.15.53:0/1229206860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c8110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f28800099b0 tx=0x7f2880009250 comp rx=0 tx=0).stop 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 -- 172.21.15.53:0/1229206860 shutdown_connections 2023-09-28T00:24:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 --2- 172.21.15.53:0/1229206860 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28900c0e00 0x7f28901595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 --2- 172.21.15.53:0/1229206860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c8110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 -- 172.21.15.53:0/1229206860 >> 172.21.15.53:0/1229206860 conn(0x7f289006f7f0 msgr2=0x7f28900cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 -- 172.21.15.53:0/1229206860 shutdown_connections 2023-09-28T00:24:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.749+0000 7f2896b9d700 1 -- 172.21.15.53:0/1229206860 wait complete. 2023-09-28T00:24:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.751+0000 7f2896b9d700 1 Processor -- start 2023-09-28T00:24:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.751+0000 7f2896b9d700 1 -- start start 2023-09-28T00:24:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2896b9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 0x7f28900b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2896b9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 0x7f28900cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2896b9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2896b9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289014f850 con 0x7f28900c6780 2023-09-28T00:24:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2896b9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28901657d0 con 0x7f28900c0e00 2023-09-28T00:24:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2896b9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2890165a90 con 0x7f2890068b40 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f289539a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 0x7f28900cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2895b9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 0x7f28900b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f289539a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 0x7f28900cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:39296/0 (socket says 172.21.15.53:39296) 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f2895b9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 0x7f28900b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:41036/0 (socket says 172.21.15.53:41036) 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f289539a700 1 -- 172.21.15.53:0/3942306950 learned_addr learned my addr 172.21.15.53:0/3942306950 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.752+0000 7f289639c700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289539a700 1 -- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 msgr2=0x7f28900b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289539a700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 0x7f28900b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289539a700 1 -- 172.21.15.53:0/3942306950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 msgr2=0x7f28900c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289539a700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289539a700 1 -- 172.21.15.53:0/3942306950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800094f0 con 0x7f28900c0e00 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289639c700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f2895b9b700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 0x7f28900b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f289539a700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 0x7f28900cb000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2880006fd0 tx=0x7f2880017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000ba60 con 0x7f28900c0e00 2023-09-28T00:24:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000bbc0 con 0x7f28900c0e00 2023-09-28T00:24:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880026660 con 0x7f28900c0e00 2023-09-28T00:24:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.753+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2890165d70 con 0x7f28900c0e00 2023-09-28T00:24:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.754+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2890166330 con 0x7f28900c0e00 2023-09-28T00:24:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.754+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289004c3c0 con 0x7f28900c0e00 2023-09-28T00:24:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.756+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2880023030 con 0x7f28900c0e00 2023-09-28T00:24:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.757+0000 7f2885ffb700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f28740673e0 0x7f2874069890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.757+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2880085e70 con 0x7f28900c0e00 2023-09-28T00:24:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.757+0000 7f2895b9b700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f28740673e0 0x7f2874069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.757+0000 7f2895b9b700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f28740673e0 0x7f2874069890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f288c011480 tx=0x7f288c0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:33.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.760+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2880052dd0 con 0x7f28900c0e00 2023-09-28T00:24:33.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.957+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28901598d0 con 0x7f28740673e0 2023-09-28T00:24:33.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.967+0000 7f2885ffb700 1 -- 172.21.15.53:0/3942306950 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310653 (secure 0 0 0) 0x7f28901598d0 con 0x7f28740673e0 2023-09-28T00:24:33.974 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:24:33.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f28740673e0 msgr2=0x7f2874069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:33.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f28740673e0 0x7f2874069890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f288c011480 tx=0x7f288c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 msgr2=0x7f28900cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:33.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 0x7f28900cb000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2880006fd0 tx=0x7f2880017000 comp rx=0 tx=0).stop 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 shutdown_connections 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f28740673e0 0x7f2874069890 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2890068b40 0x7f28900b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28900c6780 0x7f28900c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 --2- 172.21.15.53:0/3942306950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28900c0e00 0x7f28900cb000 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 >> 172.21.15.53:0/3942306950 conn(0x7f289006f7f0 msgr2=0x7f2890135a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:33.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 shutdown_connections 2023-09-28T00:24:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:33.971+0000 7f2896b9d700 1 -- 172.21.15.53:0/3942306950 wait complete. 2023-09-28T00:24:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:24:33.989 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-09-28T00:24:33.127156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24400,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":357,"ondisk_log_size":357,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":87976,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":84480,"kb_avail":754886744,"statfs":{"total":773094113280,"available":773004025856,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":86507520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003515"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:15.522682+0000","last_change":"2023-09-28T00:24:15.522642+0000","last_active":"2023-09-28T00:24:15.522682+0000","last_peered":"2023-09-28T00:24:15.522682+0000","last_clean":"2023-09-28T00:24:15.522682+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:24:15.522682+0000","last_undegraded":"2023-09-28T00:24:15.522682+0000","last_fullsized":"2023-09-28T00:24:15.522682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:15.522533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:15.522533+0000","last_clean_scrub_stamp":"2023-09-28T00:24:15.522533+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:42.534526+0000","scrub_duration":0.001556434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:04.341391+0000","last_change":"2023-09-28T00:24:04.341360+0000","last_active":"2023-09-28T00:24:04.341391+0000","last_peered":"2023-09-28T00:24:04.341391+0000","last_clean":"2023-09-28T00:24:04.341391+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:24:04.341391+0000","last_undegraded":"2023-09-28T00:24:04.341391+0000","last_fullsized":"2023-09-28T00:24:04.341391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:04.341258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:04.341258+0000","last_clean_scrub_stamp":"2023-09-28T00:24:04.341258+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:18.025763+0000","scrub_duration":0.0021714389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.092457+0000","last_change":"2023-09-28T00:23:44.092424+0000","last_active":"2023-09-28T00:23:44.092457+0000","last_peered":"2023-09-28T00:23:44.092457+0000","last_clean":"2023-09-28T00:23:44.092457+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:23:44.092457+0000","last_undegraded":"2023-09-28T00:23:44.092457+0000","last_fullsized":"2023-09-28T00:23:44.092457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.092327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:23.376972+0000","scrub_duration":0.002012476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.097707+0000","last_change":"2023-09-28T00:23:43.097674+0000","last_active":"2023-09-28T00:23:43.097707+0000","last_peered":"2023-09-28T00:23:43.097707+0000","last_clean":"2023-09-28T00:23:43.097707+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:23:43.097707+0000","last_undegraded":"2023-09-28T00:23:43.097707+0000","last_fullsized":"2023-09-28T00:23:43.097707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.097578+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:25.670621+0000","scrub_duration":0.0022080009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:50.063926+0000","last_change":"2023-09-28T00:23:50.063885+0000","last_active":"2023-09-28T00:23:50.063926+0000","last_peered":"2023-09-28T00:23:50.063926+0000","last_clean":"2023-09-28T00:23:50.063926+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:23:50.063926+0000","last_undegraded":"2023-09-28T00:23:50.063926+0000","last_fullsized":"2023-09-28T00:23:50.063926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:50.063776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:50.063776+0000","last_clean_scrub_stamp":"2023-09-28T00:23:50.063776+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:37.410551+0000","scrub_duration":0.0022425600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:17.961321+0000","last_change":"2023-09-28T00:24:17.961287+0000","last_active":"2023-09-28T00:24:17.961321+0000","last_peered":"2023-09-28T00:24:17.961321+0000","last_clean":"2023-09-28T00:24:17.961321+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:24:17.961321+0000","last_undegraded":"2023-09-28T00:24:17.961321+0000","last_fullsized":"2023-09-28T00:24:17.961321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:17.961186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:17.961186+0000","last_clean_scrub_stamp":"2023-09-28T00:24:17.961186+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:08.242614+0000","scrub_duration":0.00166909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188459+0000","last_change":"2023-09-28T00:22:59.717910+0000","last_active":"2023-09-28T00:23:02.188459+0000","last_peered":"2023-09-28T00:23:02.188459+0000","last_clean":"2023-09-28T00:23:02.188459+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:23:02.188459+0000","last_undegraded":"2023-09-28T00:23:02.188459+0000","last_fullsized":"2023-09-28T00:23:02.188459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.579129+0000","last_change":"2023-09-28T00:24:06.579084+0000","last_active":"2023-09-28T00:24:06.579129+0000","last_peered":"2023-09-28T00:24:06.579129+0000","last_clean":"2023-09-28T00:24:06.579129+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:24:06.579129+0000","last_undegraded":"2023-09-28T00:24:06.579129+0000","last_fullsized":"2023-09-28T00:24:06.579129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.578982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.578982+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.578982+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:18:42.714759+0000","scrub_duration":0.0016678210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:17.142005+0000","last_change":"2023-09-28T00:24:17.141971+0000","last_active":"2023-09-28T00:24:17.142005+0000","last_peered":"2023-09-28T00:24:17.142005+0000","last_clean":"2023-09-28T00:24:17.142005+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:24:17.142005+0000","last_undegraded":"2023-09-28T00:24:17.142005+0000","last_fullsized":"2023-09-28T00:24:17.142005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:17.141862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:17.141862+0000","last_clean_scrub_stamp":"2023-09-28T00:24:17.141862+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:08.205212+0000","scrub_duration":0.001714677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:53.568494+0000","last_change":"2023-09-28T00:23:53.568434+0000","last_active":"2023-09-28T00:23:53.568494+0000","last_peered":"2023-09-28T00:23:53.568494+0000","last_clean":"2023-09-28T00:23:53.568494+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:23:53.568494+0000","last_undegraded":"2023-09-28T00:23:53.568494+0000","last_fullsized":"2023-09-28T00:23:53.568494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:53.568345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:53.568345+0000","last_clean_scrub_stamp":"2023-09-28T00:23:53.568345+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:54.324883+0000","scrub_duration":0.001952344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.529212+0000","last_change":"2023-09-28T00:23:44.529175+0000","last_active":"2023-09-28T00:23:44.529212+0000","last_peered":"2023-09-28T00:23:44.529212+0000","last_clean":"2023-09-28T00:23:44.529212+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:23:44.529212+0000","last_undegraded":"2023-09-28T00:23:44.529212+0000","last_fullsized":"2023-09-28T00:23:44.529212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.529073+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:43.148019+0000","scrub_duration":0.001863382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:51.441168+0000","last_change":"2023-09-28T00:23:51.441138+0000","last_active":"2023-09-28T00:23:51.441168+0000","last_peered":"2023-09-28T00:23:51.441168+0000","last_clean":"2023-09-28T00:23:51.441168+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:23:51.441168+0000","last_undegraded":"2023-09-28T00:23:51.441168+0000","last_fullsized":"2023-09-28T00:23:51.441168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:51.441024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:51.441024+0000","last_clean_scrub_stamp":"2023-09-28T00:23:51.441024+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:38.787799+0000","scrub_duration":0.0027549929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:03.119660+0000","last_change":"2023-09-28T00:24:03.119631+0000","last_active":"2023-09-28T00:24:03.119660+0000","last_peered":"2023-09-28T00:24:03.119660+0000","last_clean":"2023-09-28T00:24:03.119660+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:24:03.119660+0000","last_undegraded":"2023-09-28T00:24:03.119660+0000","last_fullsized":"2023-09-28T00:24:03.119660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:03.119506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:03.119506+0000","last_clean_scrub_stamp":"2023-09-28T00:24:03.119506+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:20.043797+0000","scrub_duration":0.001752904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.544101+0000","last_change":"2023-09-28T00:23:39.544046+0000","last_active":"2023-09-28T00:23:39.544101+0000","last_peered":"2023-09-28T00:23:39.544101+0000","last_clean":"2023-09-28T00:23:39.544101+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:23:39.544101+0000","last_undegraded":"2023-09-28T00:23:39.544101+0000","last_fullsized":"2023-09-28T00:23:39.544101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.543902+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:35.374173+0000","scrub_duration":0.0021413439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.235617+0000","last_change":"2023-09-28T00:23:36.235585+0000","last_active":"2023-09-28T00:23:36.235617+0000","last_peered":"2023-09-28T00:23:36.235617+0000","last_clean":"2023-09-28T00:23:36.235617+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:23:36.235617+0000","last_undegraded":"2023-09-28T00:23:36.235617+0000","last_fullsized":"2023-09-28T00:23:36.235617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.235489+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:27.658919+0000","scrub_duration":0.0021098010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.188346+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:23:02.188346+0000","last_peered":"2023-09-28T00:23:02.188346+0000","last_clean":"2023-09-28T00:23:02.188346+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:23:02.188346+0000","last_undegraded":"2023-09-28T00:23:02.188346+0000","last_fullsized":"2023-09-28T00:23:02.188346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:02.134888+0000","last_change":"2023-09-28T00:24:02.134862+0000","last_active":"2023-09-28T00:24:02.134888+0000","last_peered":"2023-09-28T00:24:02.134888+0000","last_clean":"2023-09-28T00:24:02.134888+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:24:02.134888+0000","last_undegraded":"2023-09-28T00:24:02.134888+0000","last_fullsized":"2023-09-28T00:24:02.134888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:02.134758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:02.134758+0000","last_clean_scrub_stamp":"2023-09-28T00:24:02.134758+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:27:07.554300+0000","scrub_duration":0.0014282069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:41.178631+0000","last_change":"2023-09-28T00:23:41.178598+0000","last_active":"2023-09-28T00:23:41.178631+0000","last_peered":"2023-09-28T00:23:41.178631+0000","last_clean":"2023-09-28T00:23:41.178631+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:23:41.178631+0000","last_undegraded":"2023-09-28T00:23:41.178631+0000","last_fullsized":"2023-09-28T00:23:41.178631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_clean_scrub_stamp":"2023-09-28T00:23:41.178477+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:43.631297+0000","scrub_duration":0.0018761540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.468694+0000","last_change":"2023-09-28T00:23:56.468670+0000","last_active":"2023-09-28T00:23:56.468694+0000","last_peered":"2023-09-28T00:23:56.468694+0000","last_clean":"2023-09-28T00:23:56.468694+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:23:56.468694+0000","last_undegraded":"2023-09-28T00:23:56.468694+0000","last_fullsized":"2023-09-28T00:23:56.468694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.468571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.468571+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.468571+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:13.392863+0000","scrub_duration":0.0018490830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.532040+0000","last_change":"2023-09-28T00:23:54.531991+0000","last_active":"2023-09-28T00:23:54.532040+0000","last_peered":"2023-09-28T00:23:54.532040+0000","last_clean":"2023-09-28T00:23:54.532040+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:23:54.532040+0000","last_undegraded":"2023-09-28T00:23:54.532040+0000","last_fullsized":"2023-09-28T00:23:54.532040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.531885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.531885+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.531885+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:24:57.187820+0000","scrub_duration":0.0020695090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.500911+0000","last_change":"2023-09-28T00:23:40.500873+0000","last_active":"2023-09-28T00:23:40.500911+0000","last_peered":"2023-09-28T00:23:40.500911+0000","last_clean":"2023-09-28T00:23:40.500911+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:23:40.500911+0000","last_undegraded":"2023-09-28T00:23:40.500911+0000","last_fullsized":"2023-09-28T00:23:40.500911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.500773+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:13.242345+0000","scrub_duration":0.00202352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.081270+0000","last_change":"2023-09-28T00:23:54.081238+0000","last_active":"2023-09-28T00:23:54.081270+0000","last_peered":"2023-09-28T00:23:54.081270+0000","last_clean":"2023-09-28T00:23:54.081270+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:23:54.081270+0000","last_undegraded":"2023-09-28T00:23:54.081270+0000","last_fullsized":"2023-09-28T00:23:54.081270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.081099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.081099+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.081099+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:23:24.004765+0000","scrub_duration":0.0015460300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:07.218625+0000","last_change":"2023-09-28T00:24:07.218574+0000","last_active":"2023-09-28T00:24:07.218625+0000","last_peered":"2023-09-28T00:24:07.218625+0000","last_clean":"2023-09-28T00:24:07.218625+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:24:07.218625+0000","last_undegraded":"2023-09-28T00:24:07.218625+0000","last_fullsized":"2023-09-28T00:24:07.218625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:07.218472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:07.218472+0000","last_clean_scrub_stamp":"2023-09-28T00:24:07.218472+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:58.072255+0000","scrub_duration":0.0014751230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.489676+0000","last_change":"2023-09-28T00:24:01.489645+0000","last_active":"2023-09-28T00:24:01.489676+0000","last_peered":"2023-09-28T00:24:01.489676+0000","last_clean":"2023-09-28T00:24:01.489676+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:24:01.489676+0000","last_undegraded":"2023-09-28T00:24:01.489676+0000","last_fullsized":"2023-09-28T00:24:01.489676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.489544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.489544+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.489544+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:15.174049+0000","scrub_duration":0.0018905860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:55.047512+0000","last_change":"2023-09-28T00:23:55.047480+0000","last_active":"2023-09-28T00:23:55.047512+0000","last_peered":"2023-09-28T00:23:55.047512+0000","last_clean":"2023-09-28T00:23:55.047512+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:23:55.047512+0000","last_undegraded":"2023-09-28T00:23:55.047512+0000","last_fullsized":"2023-09-28T00:23:55.047512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:55.047351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:55.047351+0000","last_clean_scrub_stamp":"2023-09-28T00:23:55.047351+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:11.971643+0000","scrub_duration":0.0020499580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.945781+0000","last_change":"2023-09-28T00:23:45.945752+0000","last_active":"2023-09-28T00:23:45.945781+0000","last_peered":"2023-09-28T00:23:45.945781+0000","last_clean":"2023-09-28T00:23:45.945781+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:23:45.945781+0000","last_undegraded":"2023-09-28T00:23:45.945781+0000","last_fullsized":"2023-09-28T00:23:45.945781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.945643+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:22.905557+0000","scrub_duration":0.0014949780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189175+0000","last_change":"2023-09-28T00:22:59.717086+0000","last_active":"2023-09-28T00:23:02.189175+0000","last_peered":"2023-09-28T00:23:02.189175+0000","last_clean":"2023-09-28T00:23:02.189175+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:23:02.189175+0000","last_undegraded":"2023-09-28T00:23:02.189175+0000","last_fullsized":"2023-09-28T00:23:02.189175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.589615+0000","last_change":"2023-09-28T00:23:34.589582+0000","last_active":"2023-09-28T00:23:34.589615+0000","last_peered":"2023-09-28T00:23:34.589615+0000","last_clean":"2023-09-28T00:23:34.589615+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:34.589615+0000","last_undegraded":"2023-09-28T00:23:34.589615+0000","last_fullsized":"2023-09-28T00:23:34.589615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.589490+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:12:13.514087+0000","scrub_duration":0.0039604139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.983259+0000","last_change":"2023-09-28T00:23:39.983230+0000","last_active":"2023-09-28T00:23:39.983259+0000","last_peered":"2023-09-28T00:23:39.983259+0000","last_clean":"2023-09-28T00:23:39.983259+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:23:39.983259+0000","last_undegraded":"2023-09-28T00:23:39.983259+0000","last_fullsized":"2023-09-28T00:23:39.983259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.983114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:31.406543+0000","scrub_duration":0.0015432110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.110943+0000","last_change":"2023-09-28T00:23:36.110868+0000","last_active":"2023-09-28T00:23:36.110943+0000","last_peered":"2023-09-28T00:23:36.110943+0000","last_clean":"2023-09-28T00:23:36.110943+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:36.110943+0000","last_undegraded":"2023-09-28T00:23:36.110943+0000","last_fullsized":"2023-09-28T00:23:36.110943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.110764+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:13.070678+0000","scrub_duration":0.0050075609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:59.153801+0000","last_change":"2023-09-28T00:23:59.153774+0000","last_active":"2023-09-28T00:23:59.153801+0000","last_peered":"2023-09-28T00:23:59.153801+0000","last_clean":"2023-09-28T00:23:59.153801+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:23:59.153801+0000","last_undegraded":"2023-09-28T00:23:59.153801+0000","last_fullsized":"2023-09-28T00:23:59.153801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:59.153647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:59.153647+0000","last_clean_scrub_stamp":"2023-09-28T00:23:59.153647+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:19.833384+0000","scrub_duration":0.0020011970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.413348+0000","last_change":"2023-09-28T00:23:38.413300+0000","last_active":"2023-09-28T00:23:38.413348+0000","last_peered":"2023-09-28T00:23:38.413348+0000","last_clean":"2023-09-28T00:23:38.413348+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:38.413348+0000","last_undegraded":"2023-09-28T00:23:38.413348+0000","last_fullsized":"2023-09-28T00:23:38.413348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.413180+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:20.986223+0000","scrub_duration":0.0028226290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189135+0000","last_change":"2023-09-28T00:22:59.705871+0000","last_active":"2023-09-28T00:23:02.189135+0000","last_peered":"2023-09-28T00:23:02.189135+0000","last_clean":"2023-09-28T00:23:02.189135+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:23:02.189135+0000","last_undegraded":"2023-09-28T00:23:02.189135+0000","last_fullsized":"2023-09-28T00:23:02.189135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.399962+0000","last_change":"2023-09-28T00:23:37.399912+0000","last_active":"2023-09-28T00:23:37.399962+0000","last_peered":"2023-09-28T00:23:37.399962+0000","last_clean":"2023-09-28T00:23:37.399962+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:37.399962+0000","last_undegraded":"2023-09-28T00:23:37.399962+0000","last_fullsized":"2023-09-28T00:23:37.399962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.399783+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:14.359696+0000","scrub_duration":0.0050903859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:59.149371+0000","last_change":"2023-09-28T00:23:59.149341+0000","last_active":"2023-09-28T00:23:59.149371+0000","last_peered":"2023-09-28T00:23:59.149371+0000","last_clean":"2023-09-28T00:23:59.149371+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:23:59.149371+0000","last_undegraded":"2023-09-28T00:23:59.149371+0000","last_fullsized":"2023-09-28T00:23:59.149371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:59.149222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:59.149222+0000","last_clean_scrub_stamp":"2023-09-28T00:23:59.149222+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:46.495997+0000","scrub_duration":0.0022240350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.362266+0000","last_change":"2023-09-28T00:23:32.362236+0000","last_active":"2023-09-28T00:23:32.362266+0000","last_peered":"2023-09-28T00:23:32.362266+0000","last_clean":"2023-09-28T00:23:32.362266+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:32.362266+0000","last_undegraded":"2023-09-28T00:23:32.362266+0000","last_fullsized":"2023-09-28T00:23:32.362266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.362132+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:11:43.475524+0000","scrub_duration":0.001706475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:14.198616+0000","last_change":"2023-09-28T00:24:14.198586+0000","last_active":"2023-09-28T00:24:14.198616+0000","last_peered":"2023-09-28T00:24:14.198616+0000","last_clean":"2023-09-28T00:24:14.198616+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:24:14.198616+0000","last_undegraded":"2023-09-28T00:24:14.198616+0000","last_fullsized":"2023-09-28T00:24:14.198616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:14.198482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:14.198482+0000","last_clean_scrub_stamp":"2023-09-28T00:24:14.198482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:41.210474+0000","scrub_duration":0.001706969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.294191+0000","last_change":"2023-09-28T00:23:32.294167+0000","last_active":"2023-09-28T00:23:32.294191+0000","last_peered":"2023-09-28T00:23:32.294191+0000","last_clean":"2023-09-28T00:23:32.294191+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:32.294191+0000","last_undegraded":"2023-09-28T00:23:32.294191+0000","last_fullsized":"2023-09-28T00:23:32.294191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.294091+0000","objects_scrubbed":4,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:06.602627+0000","scrub_duration":0.003875613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.214625+0000","last_change":"2023-09-28T00:24:06.214576+0000","last_active":"2023-09-28T00:24:06.214625+0000","last_peered":"2023-09-28T00:24:06.214625+0000","last_clean":"2023-09-28T00:24:06.214625+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:24:06.214625+0000","last_undegraded":"2023-09-28T00:24:06.214625+0000","last_fullsized":"2023-09-28T00:24:06.214625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.214452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.214452+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.214452+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:13:58.953783+0000","scrub_duration":0.0019508920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'16","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:15.001087+0000","last_change":"2023-09-28T00:24:15.001033+0000","last_active":"2023-09-28T00:24:15.001087+0000","last_peered":"2023-09-28T00:24:15.001087+0000","last_clean":"2023-09-28T00:24:15.001087+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:24:15.001087+0000","last_undegraded":"2023-09-28T00:24:15.001087+0000","last_fullsized":"2023-09-28T00:24:15.001087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2023-09-28T00:24:15.000926+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2023-09-28T00:24:15.000926+0000","last_clean_scrub_stamp":"2023-09-28T00:24:15.000926+0000","objects_scrubbed":6,"log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:44:59.932815+0000","scrub_duration":0.0062415209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.416914+0000","last_change":"2023-09-28T00:23:34.416862+0000","last_active":"2023-09-28T00:23:34.416914+0000","last_peered":"2023-09-28T00:23:34.416914+0000","last_clean":"2023-09-28T00:23:34.416914+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:23:34.416914+0000","last_undegraded":"2023-09-28T00:23:34.416914+0000","last_fullsized":"2023-09-28T00:23:34.416914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.416729+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:46.450761+0000","scrub_duration":0.0016463960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'15","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:08.904884+0000","last_change":"2023-09-28T00:24:08.904837+0000","last_active":"2023-09-28T00:24:08.904884+0000","last_peered":"2023-09-28T00:24:08.904884+0000","last_clean":"2023-09-28T00:24:08.904884+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:24:08.904884+0000","last_undegraded":"2023-09-28T00:24:08.904884+0000","last_fullsized":"2023-09-28T00:24:08.904884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2023-09-28T00:24:08.904723+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2023-09-28T00:24:08.904723+0000","last_clean_scrub_stamp":"2023-09-28T00:24:08.904723+0000","objects_scrubbed":6,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:35.916715+0000","scrub_duration":0.0063761390000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.044593+0000","last_change":"2023-09-28T00:24:00.044566+0000","last_active":"2023-09-28T00:24:00.044593+0000","last_peered":"2023-09-28T00:24:00.044593+0000","last_clean":"2023-09-28T00:24:00.044593+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:24:00.044593+0000","last_undegraded":"2023-09-28T00:24:00.044593+0000","last_fullsized":"2023-09-28T00:24:00.044593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.044450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.044450+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.044450+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:27:05.463992+0000","scrub_duration":0.001578772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.143134+0000","last_change":"2023-09-28T00:23:35.143103+0000","last_active":"2023-09-28T00:23:35.143134+0000","last_peered":"2023-09-28T00:23:35.143134+0000","last_clean":"2023-09-28T00:23:35.143134+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:35.143134+0000","last_undegraded":"2023-09-28T00:23:35.143134+0000","last_fullsized":"2023-09-28T00:23:35.143134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.143009+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:22.819982+0000","scrub_duration":0.0043366630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.077248+0000","last_change":"2023-09-28T00:23:44.077215+0000","last_active":"2023-09-28T00:23:44.077248+0000","last_peered":"2023-09-28T00:23:44.077248+0000","last_clean":"2023-09-28T00:23:44.077248+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:23:44.077248+0000","last_undegraded":"2023-09-28T00:23:44.077248+0000","last_fullsized":"2023-09-28T00:23:44.077248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.077114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:31.423889+0000","scrub_duration":0.0016410789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.134927+0000","last_change":"2023-09-28T00:23:39.134889+0000","last_active":"2023-09-28T00:23:39.134927+0000","last_peered":"2023-09-28T00:23:39.134927+0000","last_clean":"2023-09-28T00:23:39.134927+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:39.134927+0000","last_undegraded":"2023-09-28T00:23:39.134927+0000","last_fullsized":"2023-09-28T00:23:39.134927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.134801+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:08.531014+0000","scrub_duration":0.0043778289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:13.557796+0000","last_change":"2023-09-28T00:24:13.557759+0000","last_active":"2023-09-28T00:24:13.557796+0000","last_peered":"2023-09-28T00:24:13.557796+0000","last_clean":"2023-09-28T00:24:13.557796+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:24:13.557796+0000","last_undegraded":"2023-09-28T00:24:13.557796+0000","last_fullsized":"2023-09-28T00:24:13.557796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:13.557652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:13.557652+0000","last_clean_scrub_stamp":"2023-09-28T00:24:13.557652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:23.645373+0000","scrub_duration":0.001489579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'21","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.575210+0000","last_change":"2023-09-28T00:23:32.575182+0000","last_active":"2023-09-28T00:23:32.575210+0000","last_peered":"2023-09-28T00:23:32.575210+0000","last_clean":"2023-09-28T00:23:32.575210+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:32.575210+0000","last_undegraded":"2023-09-28T00:23:32.575210+0000","last_fullsized":"2023-09-28T00:23:32.575210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.575111+0000","objects_scrubbed":8,"log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:28.818017+0000","scrub_duration":0.004538523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:08.543302+0000","last_change":"2023-09-28T00:24:08.543272+0000","last_active":"2023-09-28T00:24:08.543302+0000","last_peered":"2023-09-28T00:24:08.543302+0000","last_clean":"2023-09-28T00:24:08.543302+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:24:08.543302+0000","last_undegraded":"2023-09-28T00:24:08.543302+0000","last_fullsized":"2023-09-28T00:24:08.543302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:08.543160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:08.543160+0000","last_clean_scrub_stamp":"2023-09-28T00:24:08.543160+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:59.396943+0000","scrub_duration":0.0022213440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.319409+0000","last_change":"2023-09-28T00:23:29.319382+0000","last_active":"2023-09-28T00:23:29.319409+0000","last_peered":"2023-09-28T00:23:29.319409+0000","last_clean":"2023-09-28T00:23:29.319409+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:29.319409+0000","last_undegraded":"2023-09-28T00:23:29.319409+0000","last_fullsized":"2023-09-28T00:23:29.319409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.319298+0000","objects_scrubbed":2,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:16:37.432115+0000","scrub_duration":0.002326229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:25.936361+0000","last_change":"2023-09-28T00:24:25.936328+0000","last_active":"2023-09-28T00:24:25.936361+0000","last_peered":"2023-09-28T00:24:25.936361+0000","last_clean":"2023-09-28T00:24:25.936361+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:24:25.936361+0000","last_undegraded":"2023-09-28T00:24:25.936361+0000","last_fullsized":"2023-09-28T00:24:25.936361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:25.936206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:25.936206+0000","last_clean_scrub_stamp":"2023-09-28T00:24:25.936206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:25:47.065453+0000","scrub_duration":0.0016327830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.400420+0000","last_change":"2023-09-28T00:23:33.400388+0000","last_active":"2023-09-28T00:23:33.400420+0000","last_peered":"2023-09-28T00:23:33.400420+0000","last_clean":"2023-09-28T00:23:33.400420+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:33.400420+0000","last_undegraded":"2023-09-28T00:23:33.400420+0000","last_fullsized":"2023-09-28T00:23:33.400420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.400290+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:16:32.293022+0000","scrub_duration":0.0031017280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.549752+0000","last_change":"2023-09-28T00:23:38.549684+0000","last_active":"2023-09-28T00:23:38.549752+0000","last_peered":"2023-09-28T00:23:38.549752+0000","last_clean":"2023-09-28T00:23:38.549752+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:23:38.549752+0000","last_undegraded":"2023-09-28T00:23:38.549752+0000","last_fullsized":"2023-09-28T00:23:38.549752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.549532+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:38:59.086311+0000","scrub_duration":0.0020537279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.127159+0000","last_change":"2023-09-28T00:23:30.127112+0000","last_active":"2023-09-28T00:23:30.127159+0000","last_peered":"2023-09-28T00:23:30.127159+0000","last_clean":"2023-09-28T00:23:30.127159+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:30.127159+0000","last_undegraded":"2023-09-28T00:23:30.127159+0000","last_fullsized":"2023-09-28T00:23:30.127159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.127030+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:58.393189+0000","scrub_duration":0.00305843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.345983+0000","last_change":"2023-09-28T00:23:43.345944+0000","last_active":"2023-09-28T00:23:43.345983+0000","last_peered":"2023-09-28T00:23:43.345983+0000","last_clean":"2023-09-28T00:23:43.345983+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:23:43.345983+0000","last_undegraded":"2023-09-28T00:23:43.345983+0000","last_fullsized":"2023-09-28T00:23:43.345983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.345844+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:16.087415+0000","scrub_duration":0.0015894629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.278071+0000","last_change":"2023-09-28T00:23:33.278024+0000","last_active":"2023-09-28T00:23:33.278071+0000","last_peered":"2023-09-28T00:23:33.278071+0000","last_clean":"2023-09-28T00:23:33.278071+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:33.278071+0000","last_undegraded":"2023-09-28T00:23:33.278071+0000","last_fullsized":"2023-09-28T00:23:33.278071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.277933+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:20.954905+0000","scrub_duration":0.0026154009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:53.434646+0000","last_change":"2023-09-28T00:23:53.434610+0000","last_active":"2023-09-28T00:23:53.434646+0000","last_peered":"2023-09-28T00:23:53.434646+0000","last_clean":"2023-09-28T00:23:53.434646+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:23:53.434646+0000","last_undegraded":"2023-09-28T00:23:53.434646+0000","last_fullsized":"2023-09-28T00:23:53.434646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:53.434474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:53.434474+0000","last_clean_scrub_stamp":"2023-09-28T00:23:53.434474+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:58.854016+0000","scrub_duration":0.0017684179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.958082+0000","last_change":"2023-09-28T00:23:36.958043+0000","last_active":"2023-09-28T00:23:36.958082+0000","last_peered":"2023-09-28T00:23:36.958082+0000","last_clean":"2023-09-28T00:23:36.958082+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:36.958082+0000","last_undegraded":"2023-09-28T00:23:36.958082+0000","last_fullsized":"2023-09-28T00:23:36.958082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.957909+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:24.634881+0000","scrub_duration":0.0032571900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.135317+0000","last_change":"2023-09-28T00:23:42.135283+0000","last_active":"2023-09-28T00:23:42.135317+0000","last_peered":"2023-09-28T00:23:42.135317+0000","last_clean":"2023-09-28T00:23:42.135317+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:23:42.135317+0000","last_undegraded":"2023-09-28T00:23:42.135317+0000","last_fullsized":"2023-09-28T00:23:42.135317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.135184+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:19.095098+0000","scrub_duration":0.001635837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.120381+0000","last_change":"2023-09-28T00:23:47.120329+0000","last_active":"2023-09-28T00:23:47.120381+0000","last_peered":"2023-09-28T00:23:47.120381+0000","last_clean":"2023-09-28T00:23:47.120381+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:47.120381+0000","last_undegraded":"2023-09-28T00:23:47.120381+0000","last_fullsized":"2023-09-28T00:23:47.120381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.120219+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:52.539761+0000","scrub_duration":0.0039619049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189360+0000","last_change":"2023-09-28T00:22:59.707204+0000","last_active":"2023-09-28T00:23:02.189360+0000","last_peered":"2023-09-28T00:23:02.189360+0000","last_clean":"2023-09-28T00:23:02.189360+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:23:02.189360+0000","last_undegraded":"2023-09-28T00:23:02.189360+0000","last_fullsized":"2023-09-28T00:23:02.189360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'11","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:11.903877+0000","last_change":"2023-09-28T00:24:11.903841+0000","last_active":"2023-09-28T00:24:11.903877+0000","last_peered":"2023-09-28T00:24:11.903877+0000","last_clean":"2023-09-28T00:24:11.903877+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:24:11.903877+0000","last_undegraded":"2023-09-28T00:24:11.903877+0000","last_fullsized":"2023-09-28T00:24:11.903877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-09-28T00:24:11.903746+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-09-28T00:24:11.903746+0000","last_clean_scrub_stamp":"2023-09-28T00:24:11.903746+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:35:57.245024+0000","scrub_duration":0.0049177229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.299579+0000","last_change":"2023-09-28T00:23:56.299517+0000","last_active":"2023-09-28T00:23:56.299579+0000","last_peered":"2023-09-28T00:23:56.299579+0000","last_clean":"2023-09-28T00:23:56.299579+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:23:56.299579+0000","last_undegraded":"2023-09-28T00:23:56.299579+0000","last_fullsized":"2023-09-28T00:23:56.299579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.299388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.299388+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.299388+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:57.055926+0000","scrub_duration":0.0017635509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.085810+0000","last_change":"2023-09-28T00:23:35.085780+0000","last_active":"2023-09-28T00:23:35.085810+0000","last_peered":"2023-09-28T00:23:35.085810+0000","last_clean":"2023-09-28T00:23:35.085810+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:35.085810+0000","last_undegraded":"2023-09-28T00:23:35.085810+0000","last_fullsized":"2023-09-28T00:23:35.085810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.085669+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:37.538489+0000","scrub_duration":0.0028376410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.992118+0000","last_change":"2023-09-28T00:23:47.992070+0000","last_active":"2023-09-28T00:23:47.992118+0000","last_peered":"2023-09-28T00:23:47.992118+0000","last_clean":"2023-09-28T00:23:47.992118+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:23:47.992118+0000","last_undegraded":"2023-09-28T00:23:47.992118+0000","last_fullsized":"2023-09-28T00:23:47.992118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.991945+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:27.276590+0000","scrub_duration":0.0016691169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.390807+0000","last_change":"2023-09-28T00:23:32.390774+0000","last_active":"2023-09-28T00:23:32.390807+0000","last_peered":"2023-09-28T00:23:32.390807+0000","last_clean":"2023-09-28T00:23:32.390807+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:23:32.390807+0000","last_undegraded":"2023-09-28T00:23:32.390807+0000","last_fullsized":"2023-09-28T00:23:32.390807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.390659+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:23.814089+0000","scrub_duration":0.001476237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.350385+0000","last_change":"2023-09-28T00:23:29.350352+0000","last_active":"2023-09-28T00:23:29.350385+0000","last_peered":"2023-09-28T00:23:29.350385+0000","last_clean":"2023-09-28T00:23:29.350385+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:29.350385+0000","last_undegraded":"2023-09-28T00:23:29.350385+0000","last_fullsized":"2023-09-28T00:23:29.350385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.350273+0000","objects_scrubbed":3,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:06:24.282255+0000","scrub_duration":0.0024491669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:52.068310+0000","last_change":"2023-09-28T00:23:52.068250+0000","last_active":"2023-09-28T00:23:52.068310+0000","last_peered":"2023-09-28T00:23:52.068310+0000","last_clean":"2023-09-28T00:23:52.068310+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:23:52.068310+0000","last_undegraded":"2023-09-28T00:23:52.068310+0000","last_fullsized":"2023-09-28T00:23:52.068310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:52.068117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:52.068117+0000","last_clean_scrub_stamp":"2023-09-28T00:23:52.068117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:23:21.991783+0000","scrub_duration":0.001925312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.901921+0000","last_change":"2023-09-28T00:24:06.901889+0000","last_active":"2023-09-28T00:24:06.901921+0000","last_peered":"2023-09-28T00:24:06.901921+0000","last_clean":"2023-09-28T00:24:06.901921+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:24:06.901921+0000","last_undegraded":"2023-09-28T00:24:06.901921+0000","last_fullsized":"2023-09-28T00:24:06.901921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.901757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.901757+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.901757+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:16.989478+0000","scrub_duration":0.002189018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.293946+0000","last_change":"2023-09-28T00:23:30.293921+0000","last_active":"2023-09-28T00:23:30.293946+0000","last_peered":"2023-09-28T00:23:30.293946+0000","last_clean":"2023-09-28T00:23:30.293946+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:30.293946+0000","last_undegraded":"2023-09-28T00:23:30.293946+0000","last_fullsized":"2023-09-28T00:23:30.293946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.293841+0000","objects_scrubbed":5,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:23.134625+0000","scrub_duration":0.002485498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.095642+0000","last_change":"2023-09-28T00:23:46.095610+0000","last_active":"2023-09-28T00:23:46.095642+0000","last_peered":"2023-09-28T00:23:46.095642+0000","last_clean":"2023-09-28T00:23:46.095642+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:23:46.095642+0000","last_undegraded":"2023-09-28T00:23:46.095642+0000","last_fullsized":"2023-09-28T00:23:46.095642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.095492+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:25.380137+0000","scrub_duration":0.0014021330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.956906+0000","last_change":"2023-09-28T00:23:35.956877+0000","last_active":"2023-09-28T00:23:35.956906+0000","last_peered":"2023-09-28T00:23:35.956906+0000","last_clean":"2023-09-28T00:23:35.956906+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:23:35.956906+0000","last_undegraded":"2023-09-28T00:23:35.956906+0000","last_fullsized":"2023-09-28T00:23:35.956906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.956762+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:10.265298+0000","scrub_duration":0.00159213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.385146+0000","last_change":"2023-09-28T00:23:35.385107+0000","last_active":"2023-09-28T00:23:35.385146+0000","last_peered":"2023-09-28T00:23:35.385146+0000","last_clean":"2023-09-28T00:23:35.385146+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:35.385146+0000","last_undegraded":"2023-09-28T00:23:35.385146+0000","last_fullsized":"2023-09-28T00:23:35.385146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.384999+0000","objects_scrubbed":1,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:56.683879+0000","scrub_duration":0.003022407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.111930+0000","last_change":"2023-09-28T00:23:44.111895+0000","last_active":"2023-09-28T00:23:44.111930+0000","last_peered":"2023-09-28T00:23:44.111930+0000","last_clean":"2023-09-28T00:23:44.111930+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:23:44.111930+0000","last_undegraded":"2023-09-28T00:23:44.111930+0000","last_fullsized":"2023-09-28T00:23:44.111930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.111778+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:21.071692+0000","scrub_duration":0.0020723899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.126803+0000","last_change":"2023-09-28T00:23:54.126756+0000","last_active":"2023-09-28T00:23:54.126803+0000","last_peered":"2023-09-28T00:23:54.126803+0000","last_clean":"2023-09-28T00:23:54.126803+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:23:54.126803+0000","last_undegraded":"2023-09-28T00:23:54.126803+0000","last_fullsized":"2023-09-28T00:23:54.126803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.126652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.126652+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.126652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:14.806389+0000","scrub_duration":0.0016744850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.534399+0000","last_change":"2023-09-28T00:23:31.534372+0000","last_active":"2023-09-28T00:23:31.534399+0000","last_peered":"2023-09-28T00:23:31.534399+0000","last_clean":"2023-09-28T00:23:31.534399+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:23:31.534399+0000","last_undegraded":"2023-09-28T00:23:31.534399+0000","last_fullsized":"2023-09-28T00:23:31.534399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.534296+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:08:14.007270+0000","scrub_duration":0.0047438030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.142763+0000","last_change":"2023-09-28T00:23:37.142735+0000","last_active":"2023-09-28T00:23:37.142763+0000","last_peered":"2023-09-28T00:23:37.142763+0000","last_clean":"2023-09-28T00:23:37.142763+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:37.142763+0000","last_undegraded":"2023-09-28T00:23:37.142763+0000","last_fullsized":"2023-09-28T00:23:37.142763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.142635+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:19.715678+0000","scrub_duration":0.0044461099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:02.189335+0000","last_change":"2023-09-28T00:22:59.707033+0000","last_active":"2023-09-28T00:23:02.189335+0000","last_peered":"2023-09-28T00:23:02.189335+0000","last_clean":"2023-09-28T00:23:02.189335+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:23:02.189335+0000","last_undegraded":"2023-09-28T00:23:02.189335+0000","last_fullsized":"2023-09-28T00:23:02.189335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:22:59.182482+0000","last_clean_scrub_stamp":"2023-09-28T00:22:59.182482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.989229+0000","last_change":"2023-09-28T00:24:01.989195+0000","last_active":"2023-09-28T00:24:01.989229+0000","last_peered":"2023-09-28T00:24:01.989229+0000","last_clean":"2023-09-28T00:24:01.989229+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:24:01.989229+0000","last_undegraded":"2023-09-28T00:24:01.989229+0000","last_fullsized":"2023-09-28T00:24:01.989229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.989085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.989085+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.989085+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:52.842868+0000","scrub_duration":0.0023898869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.146002+0000","last_change":"2023-09-28T00:23:32.145963+0000","last_active":"2023-09-28T00:23:32.146002+0000","last_peered":"2023-09-28T00:23:32.146002+0000","last_clean":"2023-09-28T00:23:32.146002+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:32.146002+0000","last_undegraded":"2023-09-28T00:23:32.146002+0000","last_fullsized":"2023-09-28T00:23:32.146002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.145842+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:24.986625+0000","scrub_duration":0.0025902830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.442472+0000","last_change":"2023-09-28T00:23:46.442444+0000","last_active":"2023-09-28T00:23:46.442472+0000","last_peered":"2023-09-28T00:23:46.442472+0000","last_clean":"2023-09-28T00:23:46.442472+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:23:46.442472+0000","last_undegraded":"2023-09-28T00:23:46.442472+0000","last_fullsized":"2023-09-28T00:23:46.442472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.442331+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:15.838545+0000","scrub_duration":0.0013918260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:50.123742+0000","last_change":"2023-09-28T00:23:50.123709+0000","last_active":"2023-09-28T00:23:50.123742+0000","last_peered":"2023-09-28T00:23:50.123742+0000","last_clean":"2023-09-28T00:23:50.123742+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:23:50.123742+0000","last_undegraded":"2023-09-28T00:23:50.123742+0000","last_fullsized":"2023-09-28T00:23:50.123742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:50.123604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:50.123604+0000","last_clean_scrub_stamp":"2023-09-28T00:23:50.123604+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:07.047896+0000","scrub_duration":0.0020728830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.160690+0000","last_change":"2023-09-28T00:23:38.160661+0000","last_active":"2023-09-28T00:23:38.160690+0000","last_peered":"2023-09-28T00:23:38.160690+0000","last_clean":"2023-09-28T00:23:38.160690+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:38.160690+0000","last_undegraded":"2023-09-28T00:23:38.160690+0000","last_fullsized":"2023-09-28T00:23:38.160690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.160543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:29.583972+0000","scrub_duration":0.0015551149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.149982+0000","last_change":"2023-09-28T00:23:43.149946+0000","last_active":"2023-09-28T00:23:43.149982+0000","last_peered":"2023-09-28T00:23:43.149982+0000","last_clean":"2023-09-28T00:23:43.149982+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:23:43.149982+0000","last_undegraded":"2023-09-28T00:23:43.149982+0000","last_fullsized":"2023-09-28T00:23:43.149982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.149846+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:45.602666+0000","scrub_duration":0.0019646730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'11","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.073095+0000","last_change":"2023-09-28T00:23:45.073062+0000","last_active":"2023-09-28T00:23:45.073095+0000","last_peered":"2023-09-28T00:23:45.073095+0000","last_clean":"2023-09-28T00:23:45.073095+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:45.073095+0000","last_undegraded":"2023-09-28T00:23:45.073095+0000","last_fullsized":"2023-09-28T00:23:45.073095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.072959+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:14.469172+0000","scrub_duration":0.0043027669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.049288+0000","last_change":"2023-09-28T00:23:31.049243+0000","last_active":"2023-09-28T00:23:31.049288+0000","last_peered":"2023-09-28T00:23:31.049288+0000","last_clean":"2023-09-28T00:23:31.049288+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:23:31.049288+0000","last_undegraded":"2023-09-28T00:23:31.049288+0000","last_fullsized":"2023-09-28T00:23:31.049288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.049126+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:22.472556+0000","scrub_duration":0.0016726429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:12.242919+0000","last_change":"2023-09-28T00:24:12.242887+0000","last_active":"2023-09-28T00:24:12.242919+0000","last_peered":"2023-09-28T00:24:12.242919+0000","last_clean":"2023-09-28T00:24:12.242919+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:24:12.242919+0000","last_undegraded":"2023-09-28T00:24:12.242919+0000","last_fullsized":"2023-09-28T00:24:12.242919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:12.242752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:12.242752+0000","last_clean_scrub_stamp":"2023-09-28T00:24:12.242752+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:22.330472+0000","scrub_duration":0.002465381,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.025569+0000","last_change":"2023-09-28T00:24:01.025536+0000","last_active":"2023-09-28T00:24:01.025569+0000","last_peered":"2023-09-28T00:24:01.025569+0000","last_clean":"2023-09-28T00:24:01.025569+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:24:01.025569+0000","last_undegraded":"2023-09-28T00:24:01.025569+0000","last_fullsized":"2023-09-28T00:24:01.025569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.025433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.025433+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.025433+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:13:53.764764+0000","scrub_duration":0.0016622360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.084444+0000","last_change":"2023-09-28T00:23:34.084410+0000","last_active":"2023-09-28T00:23:34.084444+0000","last_peered":"2023-09-28T00:23:34.084444+0000","last_clean":"2023-09-28T00:23:34.084444+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:34.084444+0000","last_undegraded":"2023-09-28T00:23:34.084444+0000","last_fullsized":"2023-09-28T00:23:34.084444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.084301+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:55.383181+0000","scrub_duration":0.003197971,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.323131+0000","last_change":"2023-09-28T00:23:42.323097+0000","last_active":"2023-09-28T00:23:42.323131+0000","last_peered":"2023-09-28T00:23:42.323131+0000","last_clean":"2023-09-28T00:23:42.323131+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:23:42.323131+0000","last_undegraded":"2023-09-28T00:23:42.323131+0000","last_fullsized":"2023-09-28T00:23:42.323131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.322988+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:38.153260+0000","scrub_duration":0.0016894810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.081883+0000","last_change":"2023-09-28T00:23:39.081826+0000","last_active":"2023-09-28T00:23:39.081883+0000","last_peered":"2023-09-28T00:23:39.081883+0000","last_clean":"2023-09-28T00:23:39.081883+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:39.081883+0000","last_undegraded":"2023-09-28T00:23:39.081883+0000","last_fullsized":"2023-09-28T00:23:39.081883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.081717+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:03.473134+0000","scrub_duration":0.0047997099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:52.019821+0000","last_change":"2023-09-28T00:23:52.019791+0000","last_active":"2023-09-28T00:23:52.019821+0000","last_peered":"2023-09-28T00:23:52.019821+0000","last_clean":"2023-09-28T00:23:52.019821+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:23:52.019821+0000","last_undegraded":"2023-09-28T00:23:52.019821+0000","last_fullsized":"2023-09-28T00:23:52.019821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:52.019665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:52.019665+0000","last_clean_scrub_stamp":"2023-09-28T00:23:52.019665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:57.439207+0000","scrub_duration":0.001523052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.608016+0000","last_change":"2023-09-28T00:23:33.607964+0000","last_active":"2023-09-28T00:23:33.608016+0000","last_peered":"2023-09-28T00:23:33.608016+0000","last_clean":"2023-09-28T00:23:33.608016+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:33.608016+0000","last_undegraded":"2023-09-28T00:23:33.608016+0000","last_fullsized":"2023-09-28T00:23:33.608016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.607850+0000","objects_scrubbed":3,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:45.641882+0000","scrub_duration":0.003579807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.287201+0000","last_change":"2023-09-28T00:24:00.287167+0000","last_active":"2023-09-28T00:24:00.287201+0000","last_peered":"2023-09-28T00:24:00.287201+0000","last_clean":"2023-09-28T00:24:00.287201+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:24:00.287201+0000","last_undegraded":"2023-09-28T00:24:00.287201+0000","last_fullsized":"2023-09-28T00:24:00.287201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.287064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.287064+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.287064+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:44:09.090387+0000","scrub_duration":0.0020295830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'13","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.069809+0000","last_change":"2023-09-28T00:23:33.069768+0000","last_active":"2023-09-28T00:23:33.069809+0000","last_peered":"2023-09-28T00:23:33.069809+0000","last_clean":"2023-09-28T00:23:33.069809+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:33.069809+0000","last_undegraded":"2023-09-28T00:23:33.069809+0000","last_fullsized":"2023-09-28T00:23:33.069809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.069686+0000","objects_scrubbed":7,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:12.354331+0000","scrub_duration":0.0030685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:57.292546+0000","last_change":"2023-09-28T00:23:57.292511+0000","last_active":"2023-09-28T00:23:57.292546+0000","last_peered":"2023-09-28T00:23:57.292546+0000","last_clean":"2023-09-28T00:23:57.292546+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:23:57.292546+0000","last_undegraded":"2023-09-28T00:23:57.292546+0000","last_fullsized":"2023-09-28T00:23:57.292546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:57.292416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:57.292416+0000","last_clean_scrub_stamp":"2023-09-28T00:23:57.292416+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:24:59.948351+0000","scrub_duration":0.002143608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.390499+0000","last_change":"2023-09-28T00:23:36.390460+0000","last_active":"2023-09-28T00:23:36.390499+0000","last_peered":"2023-09-28T00:23:36.390499+0000","last_clean":"2023-09-28T00:23:36.390499+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:36.390499+0000","last_undegraded":"2023-09-28T00:23:36.390499+0000","last_fullsized":"2023-09-28T00:23:36.390499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.390358+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:38.843177+0000","scrub_duration":0.002166659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.911467+0000","last_change":"2023-09-28T00:23:44.911437+0000","last_active":"2023-09-28T00:23:44.911467+0000","last_peered":"2023-09-28T00:23:44.911467+0000","last_clean":"2023-09-28T00:23:44.911467+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:23:44.911467+0000","last_undegraded":"2023-09-28T00:23:44.911467+0000","last_fullsized":"2023-09-28T00:23:44.911467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.911323+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:47.364143+0000","scrub_duration":0.001669542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'19","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.462441+0000","last_change":"2023-09-28T00:23:40.462404+0000","last_active":"2023-09-28T00:23:40.462441+0000","last_peered":"2023-09-28T00:23:40.462441+0000","last_clean":"2023-09-28T00:23:40.462441+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:40.462441+0000","last_undegraded":"2023-09-28T00:23:40.462441+0000","last_fullsized":"2023-09-28T00:23:40.462441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.462229+0000","objects_scrubbed":6,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:04.853646+0000","scrub_duration":0.0064632149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.416065+0000","last_change":"2023-09-28T00:23:47.416035+0000","last_active":"2023-09-28T00:23:47.416065+0000","last_peered":"2023-09-28T00:23:47.416065+0000","last_clean":"2023-09-28T00:23:47.416065+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:23:47.416065+0000","last_undegraded":"2023-09-28T00:23:47.416065+0000","last_fullsized":"2023-09-28T00:23:47.416065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.415939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:46.034885+0000","scrub_duration":0.001829188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:57.495699+0000","last_change":"2023-09-28T00:23:57.495668+0000","last_active":"2023-09-28T00:23:57.495699+0000","last_peered":"2023-09-28T00:23:57.495699+0000","last_clean":"2023-09-28T00:23:57.495699+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:23:57.495699+0000","last_undegraded":"2023-09-28T00:23:57.495699+0000","last_fullsized":"2023-09-28T00:23:57.495699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:57.495535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:57.495535+0000","last_clean_scrub_stamp":"2023-09-28T00:23:57.495535+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:44:06.298858+0000","scrub_duration":0.0018793880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.993763+0000","last_change":"2023-09-28T00:23:56.993721+0000","last_active":"2023-09-28T00:23:56.993763+0000","last_peered":"2023-09-28T00:23:56.993763+0000","last_clean":"2023-09-28T00:23:56.993763+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:23:56.993763+0000","last_undegraded":"2023-09-28T00:23:56.993763+0000","last_fullsized":"2023-09-28T00:23:56.993763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.993610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.993610+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.993610+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:44.340385+0000","scrub_duration":0.0017574419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.135639+0000","last_change":"2023-09-28T00:23:40.135600+0000","last_active":"2023-09-28T00:23:40.135639+0000","last_peered":"2023-09-28T00:23:40.135639+0000","last_clean":"2023-09-28T00:23:40.135639+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:23:40.135639+0000","last_undegraded":"2023-09-28T00:23:40.135639+0000","last_fullsized":"2023-09-28T00:23:40.135639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.135470+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:01.434350+0000","scrub_duration":0.0016553480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.483832+0000","last_change":"2023-09-28T00:24:00.483782+0000","last_active":"2023-09-28T00:24:00.483832+0000","last_peered":"2023-09-28T00:24:00.483832+0000","last_clean":"2023-09-28T00:24:00.483832+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:24:00.483832+0000","last_undegraded":"2023-09-28T00:24:00.483832+0000","last_fullsized":"2023-09-28T00:24:00.483832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.483673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.483673+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.483673+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:21.163409+0000","scrub_duration":0.0023254560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:07.544107+0000","last_change":"2023-09-28T00:24:07.544081+0000","last_active":"2023-09-28T00:24:07.544107+0000","last_peered":"2023-09-28T00:24:07.544107+0000","last_clean":"2023-09-28T00:24:07.544107+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:24:07.544107+0000","last_undegraded":"2023-09-28T00:24:07.544107+0000","last_fullsized":"2023-09-28T00:24:07.544107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:07.543963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:07.543963+0000","last_clean_scrub_stamp":"2023-09-28T00:24:07.543963+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:14:00.283294+0000","scrub_duration":0.0018712030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24400,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":238,"ondisk_log_size":238,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12272,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359568,"statfs":{"total":96636764160,"available":96624197632,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.753}]},{"osd":3,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.83199999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13348,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358492,"statfs":{"total":96636764160,"available":96623095808,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.786,"5min":2.786,"15min":2.786},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.753}]},{"osd":7,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.73099999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12400,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359440,"statfs":{"total":96636764160,"available":96624066560,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.84899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.379}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.435},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Sep 28 00:23:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69599999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Sep 28 00:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.505}]},{"osd":7,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13348,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358492,"statfs":{"total":96636764160,"available":96623095808,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.624}]},{"osd":3,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.433},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.505}]},{"osd":4,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.377},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:24:33.997 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:33.997 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:33.998 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:33.998 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:33.999 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:33.999 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T00:22:59.182482+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=22, tm_sec=59, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=23, tm_sec=25, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:24:33.999 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:24:54.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:24:54.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.199+0000 7f932f39d700 1 Processor -- start 2023-09-28T00:24:54.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.199+0000 7f932f39d700 1 -- start start 2023-09-28T00:24:54.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932f39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932814d690 0x7f9328153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932f39d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f932806b1d0 0x7f93280c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932f39d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280c46f0 con 0x7f932814d2c0 2023-09-28T00:24:54.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932f39d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93281543d0 con 0x7f932806b1d0 2023-09-28T00:24:54.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932f39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280c5290 con 0x7f932814d690 2023-09-28T00:24:54.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f932806b1d0 0x7f93280c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f932806b1d0 0x7f93280c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54230/0 (socket says 172.21.15.53:54230) 2023-09-28T00:24:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932db9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932814d690 0x7f9328153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 -- 172.21.15.53:0/188083490 learned_addr learned my addr 172.21.15.53:0/188083490 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:54.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 -- 172.21.15.53:0/188083490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932814d690 msgr2=0x7f9328153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:54.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 --2- 172.21.15.53:0/188083490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932814d690 0x7f9328153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 -- 172.21.15.53:0/188083490 >> v1:172.21.15.53:6789/0 conn(0x7f932814d2c0 legacy=0x7f93280c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932eb9c700 1 -- 172.21.15.53:0/188083490 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280c3ae0 con 0x7f932806b1d0 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.201+0000 7f932db9a700 1 --2- 172.21.15.53:0/188083490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932814d690 0x7f9328153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.202+0000 7f932eb9c700 1 --2- 172.21.15.53:0/188083490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932806b1d0 0x7f93280c0f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9320009f50 tx=0x7f9320009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2a3566118ab9fa server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.202+0000 7f932d399700 1 -- 172.21.15.53:0/188083490 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932000e070 con 0x7f932806b1d0 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.202+0000 7f932d399700 1 -- 172.21.15.53:0/188083490 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932000ba50 con 0x7f932806b1d0 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.202+0000 7f932d399700 1 -- 172.21.15.53:0/188083490 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200092e0 con 0x7f932806b1d0 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.202+0000 7f932f39d700 1 -- 172.21.15.53:0/188083490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932806b1d0 msgr2=0x7f93280c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.202+0000 7f932f39d700 1 --2- 172.21.15.53:0/188083490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932806b1d0 0x7f93280c0f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9320009f50 tx=0x7f9320009840 comp rx=0 tx=0).stop 2023-09-28T00:24:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.203+0000 7f932f39d700 1 -- 172.21.15.53:0/188083490 shutdown_connections 2023-09-28T00:24:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.203+0000 7f932f39d700 1 --2- 172.21.15.53:0/188083490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932806b1d0 0x7f93280c0f80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.203+0000 7f932f39d700 1 --2- 172.21.15.53:0/188083490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932814d690 0x7f9328153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.203+0000 7f932f39d700 1 -- 172.21.15.53:0/188083490 >> 172.21.15.53:0/188083490 conn(0x7f9328067630 msgr2=0x7f9328067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.203+0000 7f932f39d700 1 -- 172.21.15.53:0/188083490 shutdown_connections 2023-09-28T00:24:54.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.203+0000 7f932f39d700 1 -- 172.21.15.53:0/188083490 wait complete. 2023-09-28T00:24:54.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.204+0000 7f932f39d700 1 Processor -- start 2023-09-28T00:24:54.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.204+0000 7f932f39d700 1 -- start start 2023-09-28T00:24:54.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932f39d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932806b1d0 0x7f93280bc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932f39d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 0x7f93280bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932f39d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f932814d690 0x7f93280bd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932f39d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280bb9d0 con 0x7f932814d2c0 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932f39d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280bbf90 con 0x7f932814d690 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932f39d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280bb5a0 con 0x7f932806b1d0 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932db9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 0x7f93280bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932db9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 0x7f93280bcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54236/0 (socket says 172.21.15.53:54236) 2023-09-28T00:24:54.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932db9a700 1 -- 172.21.15.53:0/511417063 learned_addr learned my addr 172.21.15.53:0/511417063 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932e39b700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932806b1d0 0x7f93280bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.205+0000 7f932eb9c700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f932814d690 0x7f93280bd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932db9a700 1 -- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932806b1d0 msgr2=0x7f93280bc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932db9a700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932806b1d0 0x7f93280bc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932db9a700 1 -- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f932814d690 msgr2=0x7f93280bd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932db9a700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f932814d690 0x7f93280bd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932db9a700 1 -- 172.21.15.53:0/511417063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009420 con 0x7f932814d2c0 2023-09-28T00:24:54.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932db9a700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 0x7f93280bcf10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f931800ecb0 tx=0x7f93180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:54.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800c850 con 0x7f932814d2c0 2023-09-28T00:24:54.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800c9b0 con 0x7f932814d2c0 2023-09-28T00:24:54.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9320009ae0 con 0x7f932814d2c0 2023-09-28T00:24:54.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800cd50 con 0x7f932814d2c0 2023-09-28T00:24:54.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.206+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9328164310 con 0x7f932814d2c0 2023-09-28T00:24:54.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.207+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93280bc0d0 con 0x7f932814d2c0 2023-09-28T00:24:54.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.208+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9318013680 con 0x7f932814d2c0 2023-09-28T00:24:54.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.209+0000 7f931e7fc700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f930c067360 0x7f930c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.209+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9318084f90 con 0x7f932814d2c0 2023-09-28T00:24:54.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.210+0000 7f932e39b700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f930c067360 0x7f930c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.210+0000 7f932e39b700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f930c067360 0x7f930c069810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9324003a80 tx=0x7f9324007ec0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:54.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.214+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f93280bc0d0 con 0x7f932814d2c0 2023-09-28T00:24:54.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.411+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 --> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93280bc0d0 con 0x7f930c067360 2023-09-28T00:24:54.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.421+0000 7f931e7fc700 1 -- 172.21.15.53:0/511417063 <== mgr.4109 v2:172.21.15.118:6832/120136 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311476 (secure 0 0 0) 0x7f93280bc0d0 con 0x7f930c067360 2023-09-28T00:24:54.425 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:24:54.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f930c067360 msgr2=0x7f930c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f930c067360 0x7f930c069810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9324003a80 tx=0x7f9324007ec0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 msgr2=0x7f93280bcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 0x7f93280bcf10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f931800ecb0 tx=0x7f93180091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 shutdown_connections 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f930c067360 0x7f930c069810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f932806b1d0 0x7f93280bc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f932814d690 0x7f93280bd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 --2- 172.21.15.53:0/511417063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f932814d2c0 0x7f93280bcf10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 >> 172.21.15.53:0/511417063 conn(0x7f9328067630 msgr2=0x7f932814b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 shutdown_connections 2023-09-28T00:24:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.425+0000 7f932f39d700 1 -- 172.21.15.53:0/511417063 wait complete. 2023-09-28T00:24:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-09-28T00:24:54.442 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-09-28T00:24:53.132542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597994,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24400,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":357,"ondisk_log_size":357,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":87976,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":84480,"kb_avail":754886744,"statfs":{"total":773094113280,"available":773004025856,"internally_reserved":0,"allocated":3514368,"data_stored":1969004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":86507520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003697"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:15.522682+0000","last_change":"2023-09-28T00:24:15.522642+0000","last_active":"2023-09-28T00:24:15.522682+0000","last_peered":"2023-09-28T00:24:15.522682+0000","last_clean":"2023-09-28T00:24:15.522682+0000","last_became_active":"2023-09-28T00:22:59.702225+0000","last_became_peered":"2023-09-28T00:22:59.702225+0000","last_unstale":"2023-09-28T00:24:15.522682+0000","last_undegraded":"2023-09-28T00:24:15.522682+0000","last_fullsized":"2023-09-28T00:24:15.522682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:15.522533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:15.522533+0000","last_clean_scrub_stamp":"2023-09-28T00:24:15.522533+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:42.534526+0000","scrub_duration":0.001556434,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:04.341391+0000","last_change":"2023-09-28T00:24:04.341360+0000","last_active":"2023-09-28T00:24:04.341391+0000","last_peered":"2023-09-28T00:24:04.341391+0000","last_clean":"2023-09-28T00:24:04.341391+0000","last_became_active":"2023-09-28T00:22:59.707761+0000","last_became_peered":"2023-09-28T00:22:59.707761+0000","last_unstale":"2023-09-28T00:24:04.341391+0000","last_undegraded":"2023-09-28T00:24:04.341391+0000","last_fullsized":"2023-09-28T00:24:04.341391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:04.341258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:04.341258+0000","last_clean_scrub_stamp":"2023-09-28T00:24:04.341258+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:18.025763+0000","scrub_duration":0.0021714389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.092457+0000","last_change":"2023-09-28T00:23:44.092424+0000","last_active":"2023-09-28T00:23:44.092457+0000","last_peered":"2023-09-28T00:23:44.092457+0000","last_clean":"2023-09-28T00:23:44.092457+0000","last_became_active":"2023-09-28T00:22:59.704537+0000","last_became_peered":"2023-09-28T00:22:59.704537+0000","last_unstale":"2023-09-28T00:23:44.092457+0000","last_undegraded":"2023-09-28T00:23:44.092457+0000","last_fullsized":"2023-09-28T00:23:44.092457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.092327+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.092327+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:23.376972+0000","scrub_duration":0.002012476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.097707+0000","last_change":"2023-09-28T00:23:43.097674+0000","last_active":"2023-09-28T00:23:43.097707+0000","last_peered":"2023-09-28T00:23:43.097707+0000","last_clean":"2023-09-28T00:23:43.097707+0000","last_became_active":"2023-09-28T00:22:59.709761+0000","last_became_peered":"2023-09-28T00:22:59.709761+0000","last_unstale":"2023-09-28T00:23:43.097707+0000","last_undegraded":"2023-09-28T00:23:43.097707+0000","last_fullsized":"2023-09-28T00:23:43.097707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.097578+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.097578+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:25.670621+0000","scrub_duration":0.0022080009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:50.063926+0000","last_change":"2023-09-28T00:23:50.063885+0000","last_active":"2023-09-28T00:23:50.063926+0000","last_peered":"2023-09-28T00:23:50.063926+0000","last_clean":"2023-09-28T00:23:50.063926+0000","last_became_active":"2023-09-28T00:22:59.708943+0000","last_became_peered":"2023-09-28T00:22:59.708943+0000","last_unstale":"2023-09-28T00:23:50.063926+0000","last_undegraded":"2023-09-28T00:23:50.063926+0000","last_fullsized":"2023-09-28T00:23:50.063926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:50.063776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:50.063776+0000","last_clean_scrub_stamp":"2023-09-28T00:23:50.063776+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:37.410551+0000","scrub_duration":0.0022425600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:17.961321+0000","last_change":"2023-09-28T00:24:17.961287+0000","last_active":"2023-09-28T00:24:17.961321+0000","last_peered":"2023-09-28T00:24:17.961321+0000","last_clean":"2023-09-28T00:24:17.961321+0000","last_became_active":"2023-09-28T00:22:59.713658+0000","last_became_peered":"2023-09-28T00:22:59.713658+0000","last_unstale":"2023-09-28T00:24:17.961321+0000","last_undegraded":"2023-09-28T00:24:17.961321+0000","last_fullsized":"2023-09-28T00:24:17.961321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:17.961186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:17.961186+0000","last_clean_scrub_stamp":"2023-09-28T00:24:17.961186+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:08.242614+0000","scrub_duration":0.00166909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:34.949120+0000","last_change":"2023-09-28T00:24:34.949085+0000","last_active":"2023-09-28T00:24:34.949120+0000","last_peered":"2023-09-28T00:24:34.949120+0000","last_clean":"2023-09-28T00:24:34.949120+0000","last_became_active":"2023-09-28T00:22:59.717673+0000","last_became_peered":"2023-09-28T00:22:59.717673+0000","last_unstale":"2023-09-28T00:24:34.949120+0000","last_undegraded":"2023-09-28T00:24:34.949120+0000","last_fullsized":"2023-09-28T00:24:34.949120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:34.948975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:34.948975+0000","last_clean_scrub_stamp":"2023-09-28T00:24:34.948975+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:25:07.463006+0000","scrub_duration":0.001778927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.579129+0000","last_change":"2023-09-28T00:24:06.579084+0000","last_active":"2023-09-28T00:24:06.579129+0000","last_peered":"2023-09-28T00:24:06.579129+0000","last_clean":"2023-09-28T00:24:06.579129+0000","last_became_active":"2023-09-28T00:22:59.702034+0000","last_became_peered":"2023-09-28T00:22:59.702034+0000","last_unstale":"2023-09-28T00:24:06.579129+0000","last_undegraded":"2023-09-28T00:24:06.579129+0000","last_fullsized":"2023-09-28T00:24:06.579129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.578982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.578982+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.578982+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:18:42.714759+0000","scrub_duration":0.0016678210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:17.142005+0000","last_change":"2023-09-28T00:24:17.141971+0000","last_active":"2023-09-28T00:24:17.142005+0000","last_peered":"2023-09-28T00:24:17.142005+0000","last_clean":"2023-09-28T00:24:17.142005+0000","last_became_active":"2023-09-28T00:22:59.703461+0000","last_became_peered":"2023-09-28T00:22:59.703461+0000","last_unstale":"2023-09-28T00:24:17.142005+0000","last_undegraded":"2023-09-28T00:24:17.142005+0000","last_fullsized":"2023-09-28T00:24:17.142005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:17.141862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:17.141862+0000","last_clean_scrub_stamp":"2023-09-28T00:24:17.141862+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:08.205212+0000","scrub_duration":0.001714677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:53.568494+0000","last_change":"2023-09-28T00:23:53.568434+0000","last_active":"2023-09-28T00:23:53.568494+0000","last_peered":"2023-09-28T00:23:53.568494+0000","last_clean":"2023-09-28T00:23:53.568494+0000","last_became_active":"2023-09-28T00:22:59.693426+0000","last_became_peered":"2023-09-28T00:22:59.693426+0000","last_unstale":"2023-09-28T00:23:53.568494+0000","last_undegraded":"2023-09-28T00:23:53.568494+0000","last_fullsized":"2023-09-28T00:23:53.568494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:53.568345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:53.568345+0000","last_clean_scrub_stamp":"2023-09-28T00:23:53.568345+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:54.324883+0000","scrub_duration":0.001952344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.529212+0000","last_change":"2023-09-28T00:23:44.529175+0000","last_active":"2023-09-28T00:23:44.529212+0000","last_peered":"2023-09-28T00:23:44.529212+0000","last_clean":"2023-09-28T00:23:44.529212+0000","last_became_active":"2023-09-28T00:22:59.705088+0000","last_became_peered":"2023-09-28T00:22:59.705088+0000","last_unstale":"2023-09-28T00:23:44.529212+0000","last_undegraded":"2023-09-28T00:23:44.529212+0000","last_fullsized":"2023-09-28T00:23:44.529212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.529073+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.529073+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:43.148019+0000","scrub_duration":0.001863382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:51.441168+0000","last_change":"2023-09-28T00:23:51.441138+0000","last_active":"2023-09-28T00:23:51.441168+0000","last_peered":"2023-09-28T00:23:51.441168+0000","last_clean":"2023-09-28T00:23:51.441168+0000","last_became_active":"2023-09-28T00:22:59.714457+0000","last_became_peered":"2023-09-28T00:22:59.714457+0000","last_unstale":"2023-09-28T00:23:51.441168+0000","last_undegraded":"2023-09-28T00:23:51.441168+0000","last_fullsized":"2023-09-28T00:23:51.441168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:51.441024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:51.441024+0000","last_clean_scrub_stamp":"2023-09-28T00:23:51.441024+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:38.787799+0000","scrub_duration":0.0027549929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:03.119660+0000","last_change":"2023-09-28T00:24:03.119631+0000","last_active":"2023-09-28T00:24:03.119660+0000","last_peered":"2023-09-28T00:24:03.119660+0000","last_clean":"2023-09-28T00:24:03.119660+0000","last_became_active":"2023-09-28T00:22:59.698356+0000","last_became_peered":"2023-09-28T00:22:59.698356+0000","last_unstale":"2023-09-28T00:24:03.119660+0000","last_undegraded":"2023-09-28T00:24:03.119660+0000","last_fullsized":"2023-09-28T00:24:03.119660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:03.119506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:03.119506+0000","last_clean_scrub_stamp":"2023-09-28T00:24:03.119506+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:20.043797+0000","scrub_duration":0.001752904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.544101+0000","last_change":"2023-09-28T00:23:39.544046+0000","last_active":"2023-09-28T00:23:39.544101+0000","last_peered":"2023-09-28T00:23:39.544101+0000","last_clean":"2023-09-28T00:23:39.544101+0000","last_became_active":"2023-09-28T00:22:59.715857+0000","last_became_peered":"2023-09-28T00:22:59.715857+0000","last_unstale":"2023-09-28T00:23:39.544101+0000","last_undegraded":"2023-09-28T00:23:39.544101+0000","last_fullsized":"2023-09-28T00:23:39.544101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.543902+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.543902+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:35.374173+0000","scrub_duration":0.0021413439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.235617+0000","last_change":"2023-09-28T00:23:36.235585+0000","last_active":"2023-09-28T00:23:36.235617+0000","last_peered":"2023-09-28T00:23:36.235617+0000","last_clean":"2023-09-28T00:23:36.235617+0000","last_became_active":"2023-09-28T00:22:59.711476+0000","last_became_peered":"2023-09-28T00:22:59.711476+0000","last_unstale":"2023-09-28T00:23:36.235617+0000","last_undegraded":"2023-09-28T00:23:36.235617+0000","last_fullsized":"2023-09-28T00:23:36.235617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:36.235489+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.235489+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:27.658919+0000","scrub_duration":0.0021098010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:44.874835+0000","last_change":"2023-09-28T00:24:44.874775+0000","last_active":"2023-09-28T00:24:44.874835+0000","last_peered":"2023-09-28T00:24:44.874835+0000","last_clean":"2023-09-28T00:24:44.874835+0000","last_became_active":"2023-09-28T00:22:59.706814+0000","last_became_peered":"2023-09-28T00:22:59.706814+0000","last_unstale":"2023-09-28T00:24:44.874835+0000","last_undegraded":"2023-09-28T00:24:44.874835+0000","last_fullsized":"2023-09-28T00:24:44.874835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:44.874668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:44.874668+0000","last_clean_scrub_stamp":"2023-09-28T00:24:44.874668+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:43:22.897830+0000","scrub_duration":0.002106503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:02.134888+0000","last_change":"2023-09-28T00:24:02.134862+0000","last_active":"2023-09-28T00:24:02.134888+0000","last_peered":"2023-09-28T00:24:02.134888+0000","last_clean":"2023-09-28T00:24:02.134888+0000","last_became_active":"2023-09-28T00:22:59.702706+0000","last_became_peered":"2023-09-28T00:22:59.702706+0000","last_unstale":"2023-09-28T00:24:02.134888+0000","last_undegraded":"2023-09-28T00:24:02.134888+0000","last_fullsized":"2023-09-28T00:24:02.134888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:02.134758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:02.134758+0000","last_clean_scrub_stamp":"2023-09-28T00:24:02.134758+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:27:07.554300+0000","scrub_duration":0.0014282069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:41.178631+0000","last_change":"2023-09-28T00:23:41.178598+0000","last_active":"2023-09-28T00:23:41.178631+0000","last_peered":"2023-09-28T00:23:41.178631+0000","last_clean":"2023-09-28T00:23:41.178631+0000","last_became_active":"2023-09-28T00:22:59.705768+0000","last_became_peered":"2023-09-28T00:22:59.705768+0000","last_unstale":"2023-09-28T00:23:41.178631+0000","last_undegraded":"2023-09-28T00:23:41.178631+0000","last_fullsized":"2023-09-28T00:23:41.178631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:41.178477+0000","last_clean_scrub_stamp":"2023-09-28T00:23:41.178477+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:43.631297+0000","scrub_duration":0.0018761540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.468694+0000","last_change":"2023-09-28T00:23:56.468670+0000","last_active":"2023-09-28T00:23:56.468694+0000","last_peered":"2023-09-28T00:23:56.468694+0000","last_clean":"2023-09-28T00:23:56.468694+0000","last_became_active":"2023-09-28T00:22:59.714450+0000","last_became_peered":"2023-09-28T00:22:59.714450+0000","last_unstale":"2023-09-28T00:23:56.468694+0000","last_undegraded":"2023-09-28T00:23:56.468694+0000","last_fullsized":"2023-09-28T00:23:56.468694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.468571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.468571+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.468571+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:13.392863+0000","scrub_duration":0.0018490830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.532040+0000","last_change":"2023-09-28T00:23:54.531991+0000","last_active":"2023-09-28T00:23:54.532040+0000","last_peered":"2023-09-28T00:23:54.532040+0000","last_clean":"2023-09-28T00:23:54.532040+0000","last_became_active":"2023-09-28T00:22:59.703239+0000","last_became_peered":"2023-09-28T00:22:59.703239+0000","last_unstale":"2023-09-28T00:23:54.532040+0000","last_undegraded":"2023-09-28T00:23:54.532040+0000","last_fullsized":"2023-09-28T00:23:54.532040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.531885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.531885+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.531885+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:24:57.187820+0000","scrub_duration":0.0020695090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.500911+0000","last_change":"2023-09-28T00:23:40.500873+0000","last_active":"2023-09-28T00:23:40.500911+0000","last_peered":"2023-09-28T00:23:40.500911+0000","last_clean":"2023-09-28T00:23:40.500911+0000","last_became_active":"2023-09-28T00:22:59.716038+0000","last_became_peered":"2023-09-28T00:22:59.716038+0000","last_unstale":"2023-09-28T00:23:40.500911+0000","last_undegraded":"2023-09-28T00:23:40.500911+0000","last_fullsized":"2023-09-28T00:23:40.500911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.500773+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.500773+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:13.242345+0000","scrub_duration":0.00202352,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.081270+0000","last_change":"2023-09-28T00:23:54.081238+0000","last_active":"2023-09-28T00:23:54.081270+0000","last_peered":"2023-09-28T00:23:54.081270+0000","last_clean":"2023-09-28T00:23:54.081270+0000","last_became_active":"2023-09-28T00:22:59.703454+0000","last_became_peered":"2023-09-28T00:22:59.703454+0000","last_unstale":"2023-09-28T00:23:54.081270+0000","last_undegraded":"2023-09-28T00:23:54.081270+0000","last_fullsized":"2023-09-28T00:23:54.081270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.081099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.081099+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.081099+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:23:24.004765+0000","scrub_duration":0.0015460300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:07.218625+0000","last_change":"2023-09-28T00:24:07.218574+0000","last_active":"2023-09-28T00:24:07.218625+0000","last_peered":"2023-09-28T00:24:07.218625+0000","last_clean":"2023-09-28T00:24:07.218625+0000","last_became_active":"2023-09-28T00:22:59.702110+0000","last_became_peered":"2023-09-28T00:22:59.702110+0000","last_unstale":"2023-09-28T00:24:07.218625+0000","last_undegraded":"2023-09-28T00:24:07.218625+0000","last_fullsized":"2023-09-28T00:24:07.218625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:07.218472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:07.218472+0000","last_clean_scrub_stamp":"2023-09-28T00:24:07.218472+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:58.072255+0000","scrub_duration":0.0014751230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.489676+0000","last_change":"2023-09-28T00:24:01.489645+0000","last_active":"2023-09-28T00:24:01.489676+0000","last_peered":"2023-09-28T00:24:01.489676+0000","last_clean":"2023-09-28T00:24:01.489676+0000","last_became_active":"2023-09-28T00:22:59.706473+0000","last_became_peered":"2023-09-28T00:22:59.706473+0000","last_unstale":"2023-09-28T00:24:01.489676+0000","last_undegraded":"2023-09-28T00:24:01.489676+0000","last_fullsized":"2023-09-28T00:24:01.489676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.489544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.489544+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.489544+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:11:15.174049+0000","scrub_duration":0.0018905860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:55.047512+0000","last_change":"2023-09-28T00:23:55.047480+0000","last_active":"2023-09-28T00:23:55.047512+0000","last_peered":"2023-09-28T00:23:55.047512+0000","last_clean":"2023-09-28T00:23:55.047512+0000","last_became_active":"2023-09-28T00:22:59.718591+0000","last_became_peered":"2023-09-28T00:22:59.718591+0000","last_unstale":"2023-09-28T00:23:55.047512+0000","last_undegraded":"2023-09-28T00:23:55.047512+0000","last_fullsized":"2023-09-28T00:23:55.047512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:55.047351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:55.047351+0000","last_clean_scrub_stamp":"2023-09-28T00:23:55.047351+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:11.971643+0000","scrub_duration":0.0020499580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.945781+0000","last_change":"2023-09-28T00:23:45.945752+0000","last_active":"2023-09-28T00:23:45.945781+0000","last_peered":"2023-09-28T00:23:45.945781+0000","last_clean":"2023-09-28T00:23:45.945781+0000","last_became_active":"2023-09-28T00:22:59.700975+0000","last_became_peered":"2023-09-28T00:22:59.700975+0000","last_unstale":"2023-09-28T00:23:45.945781+0000","last_undegraded":"2023-09-28T00:23:45.945781+0000","last_fullsized":"2023-09-28T00:23:45.945781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:45.945643+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.945643+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:22.905557+0000","scrub_duration":0.0014949780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:48.784799+0000","last_change":"2023-09-28T00:24:48.784753+0000","last_active":"2023-09-28T00:24:48.784799+0000","last_peered":"2023-09-28T00:24:48.784799+0000","last_clean":"2023-09-28T00:24:48.784799+0000","last_became_active":"2023-09-28T00:22:59.716834+0000","last_became_peered":"2023-09-28T00:22:59.716834+0000","last_unstale":"2023-09-28T00:24:48.784799+0000","last_undegraded":"2023-09-28T00:24:48.784799+0000","last_fullsized":"2023-09-28T00:24:48.784799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:48.784652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:48.784652+0000","last_clean_scrub_stamp":"2023-09-28T00:24:48.784652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:26:12.626203+0000","scrub_duration":0.001755221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.589615+0000","last_change":"2023-09-28T00:23:34.589582+0000","last_active":"2023-09-28T00:23:34.589615+0000","last_peered":"2023-09-28T00:23:34.589615+0000","last_clean":"2023-09-28T00:23:34.589615+0000","last_became_active":"2023-09-28T00:22:59.203667+0000","last_became_peered":"2023-09-28T00:22:59.203667+0000","last_unstale":"2023-09-28T00:23:34.589615+0000","last_undegraded":"2023-09-28T00:23:34.589615+0000","last_fullsized":"2023-09-28T00:23:34.589615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.589490+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.589490+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:12:13.514087+0000","scrub_duration":0.0039604139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.983259+0000","last_change":"2023-09-28T00:23:39.983230+0000","last_active":"2023-09-28T00:23:39.983259+0000","last_peered":"2023-09-28T00:23:39.983259+0000","last_clean":"2023-09-28T00:23:39.983259+0000","last_became_active":"2023-09-28T00:22:59.701192+0000","last_became_peered":"2023-09-28T00:22:59.701192+0000","last_unstale":"2023-09-28T00:23:39.983259+0000","last_undegraded":"2023-09-28T00:23:39.983259+0000","last_fullsized":"2023-09-28T00:23:39.983259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:39.983114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.983114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:31.406543+0000","scrub_duration":0.0015432110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.110943+0000","last_change":"2023-09-28T00:23:36.110868+0000","last_active":"2023-09-28T00:23:36.110943+0000","last_peered":"2023-09-28T00:23:36.110943+0000","last_clean":"2023-09-28T00:23:36.110943+0000","last_became_active":"2023-09-28T00:22:59.215026+0000","last_became_peered":"2023-09-28T00:22:59.215026+0000","last_unstale":"2023-09-28T00:23:36.110943+0000","last_undegraded":"2023-09-28T00:23:36.110943+0000","last_fullsized":"2023-09-28T00:23:36.110943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:36.110764+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.110764+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:13.070678+0000","scrub_duration":0.0050075609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:59.153801+0000","last_change":"2023-09-28T00:23:59.153774+0000","last_active":"2023-09-28T00:23:59.153801+0000","last_peered":"2023-09-28T00:23:59.153801+0000","last_clean":"2023-09-28T00:23:59.153801+0000","last_became_active":"2023-09-28T00:22:59.704511+0000","last_became_peered":"2023-09-28T00:22:59.704511+0000","last_unstale":"2023-09-28T00:23:59.153801+0000","last_undegraded":"2023-09-28T00:23:59.153801+0000","last_fullsized":"2023-09-28T00:23:59.153801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:59.153647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:59.153647+0000","last_clean_scrub_stamp":"2023-09-28T00:23:59.153647+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:19.833384+0000","scrub_duration":0.0020011970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.413348+0000","last_change":"2023-09-28T00:23:38.413300+0000","last_active":"2023-09-28T00:23:38.413348+0000","last_peered":"2023-09-28T00:23:38.413348+0000","last_clean":"2023-09-28T00:23:38.413348+0000","last_became_active":"2023-09-28T00:22:59.202422+0000","last_became_peered":"2023-09-28T00:22:59.202422+0000","last_unstale":"2023-09-28T00:23:38.413348+0000","last_undegraded":"2023-09-28T00:23:38.413348+0000","last_fullsized":"2023-09-28T00:23:38.413348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:38.413180+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.413180+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:20.986223+0000","scrub_duration":0.0028226290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:33.966678+0000","last_change":"2023-09-28T00:24:33.966653+0000","last_active":"2023-09-28T00:24:33.966678+0000","last_peered":"2023-09-28T00:24:33.966678+0000","last_clean":"2023-09-28T00:24:33.966678+0000","last_became_active":"2023-09-28T00:22:59.705559+0000","last_became_peered":"2023-09-28T00:22:59.705559+0000","last_unstale":"2023-09-28T00:24:33.966678+0000","last_undegraded":"2023-09-28T00:24:33.966678+0000","last_fullsized":"2023-09-28T00:24:33.966678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:33.966564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:33.966564+0000","last_clean_scrub_stamp":"2023-09-28T00:24:33.966564+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:35:27.196995+0000","scrub_duration":0.0017957959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.399962+0000","last_change":"2023-09-28T00:23:37.399912+0000","last_active":"2023-09-28T00:23:37.399962+0000","last_peered":"2023-09-28T00:23:37.399962+0000","last_clean":"2023-09-28T00:23:37.399962+0000","last_became_active":"2023-09-28T00:22:59.202837+0000","last_became_peered":"2023-09-28T00:22:59.202837+0000","last_unstale":"2023-09-28T00:23:37.399962+0000","last_undegraded":"2023-09-28T00:23:37.399962+0000","last_fullsized":"2023-09-28T00:23:37.399962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.399783+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.399783+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:14.359696+0000","scrub_duration":0.0050903859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:59.149371+0000","last_change":"2023-09-28T00:23:59.149341+0000","last_active":"2023-09-28T00:23:59.149371+0000","last_peered":"2023-09-28T00:23:59.149371+0000","last_clean":"2023-09-28T00:23:59.149371+0000","last_became_active":"2023-09-28T00:22:59.714587+0000","last_became_peered":"2023-09-28T00:22:59.714587+0000","last_unstale":"2023-09-28T00:23:59.149371+0000","last_undegraded":"2023-09-28T00:23:59.149371+0000","last_fullsized":"2023-09-28T00:23:59.149371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:59.149222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:59.149222+0000","last_clean_scrub_stamp":"2023-09-28T00:23:59.149222+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:46.495997+0000","scrub_duration":0.0022240350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.362266+0000","last_change":"2023-09-28T00:23:32.362236+0000","last_active":"2023-09-28T00:23:32.362266+0000","last_peered":"2023-09-28T00:23:32.362266+0000","last_clean":"2023-09-28T00:23:32.362266+0000","last_became_active":"2023-09-28T00:22:59.199316+0000","last_became_peered":"2023-09-28T00:22:59.199316+0000","last_unstale":"2023-09-28T00:23:32.362266+0000","last_undegraded":"2023-09-28T00:23:32.362266+0000","last_fullsized":"2023-09-28T00:23:32.362266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:32.362132+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.362132+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:11:43.475524+0000","scrub_duration":0.001706475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:14.198616+0000","last_change":"2023-09-28T00:24:14.198586+0000","last_active":"2023-09-28T00:24:14.198616+0000","last_peered":"2023-09-28T00:24:14.198616+0000","last_clean":"2023-09-28T00:24:14.198616+0000","last_became_active":"2023-09-28T00:22:59.708472+0000","last_became_peered":"2023-09-28T00:22:59.708472+0000","last_unstale":"2023-09-28T00:24:14.198616+0000","last_undegraded":"2023-09-28T00:24:14.198616+0000","last_fullsized":"2023-09-28T00:24:14.198616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:14.198482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:14.198482+0000","last_clean_scrub_stamp":"2023-09-28T00:24:14.198482+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:41.210474+0000","scrub_duration":0.001706969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.294191+0000","last_change":"2023-09-28T00:23:32.294167+0000","last_active":"2023-09-28T00:23:32.294191+0000","last_peered":"2023-09-28T00:23:32.294191+0000","last_clean":"2023-09-28T00:23:32.294191+0000","last_became_active":"2023-09-28T00:22:59.216725+0000","last_became_peered":"2023-09-28T00:22:59.216725+0000","last_unstale":"2023-09-28T00:23:32.294191+0000","last_undegraded":"2023-09-28T00:23:32.294191+0000","last_fullsized":"2023-09-28T00:23:32.294191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:32.294091+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.294091+0000","objects_scrubbed":4,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:06.602627+0000","scrub_duration":0.003875613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.214625+0000","last_change":"2023-09-28T00:24:06.214576+0000","last_active":"2023-09-28T00:24:06.214625+0000","last_peered":"2023-09-28T00:24:06.214625+0000","last_clean":"2023-09-28T00:24:06.214625+0000","last_became_active":"2023-09-28T00:22:59.718655+0000","last_became_peered":"2023-09-28T00:22:59.718655+0000","last_unstale":"2023-09-28T00:24:06.214625+0000","last_undegraded":"2023-09-28T00:24:06.214625+0000","last_fullsized":"2023-09-28T00:24:06.214625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.214452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.214452+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.214452+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:13:58.953783+0000","scrub_duration":0.0019508920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'16","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:15.001087+0000","last_change":"2023-09-28T00:24:15.001033+0000","last_active":"2023-09-28T00:24:15.001087+0000","last_peered":"2023-09-28T00:24:15.001087+0000","last_clean":"2023-09-28T00:24:15.001087+0000","last_became_active":"2023-09-28T00:22:59.204243+0000","last_became_peered":"2023-09-28T00:22:59.204243+0000","last_unstale":"2023-09-28T00:24:15.001087+0000","last_undegraded":"2023-09-28T00:24:15.001087+0000","last_fullsized":"2023-09-28T00:24:15.001087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2023-09-28T00:24:15.000926+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2023-09-28T00:24:15.000926+0000","last_clean_scrub_stamp":"2023-09-28T00:24:15.000926+0000","objects_scrubbed":6,"log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:44:59.932815+0000","scrub_duration":0.0062415209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.416914+0000","last_change":"2023-09-28T00:23:34.416862+0000","last_active":"2023-09-28T00:23:34.416914+0000","last_peered":"2023-09-28T00:23:34.416914+0000","last_clean":"2023-09-28T00:23:34.416914+0000","last_became_active":"2023-09-28T00:22:59.718767+0000","last_became_peered":"2023-09-28T00:22:59.718767+0000","last_unstale":"2023-09-28T00:23:34.416914+0000","last_undegraded":"2023-09-28T00:23:34.416914+0000","last_fullsized":"2023-09-28T00:23:34.416914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:34.416729+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.416729+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:46.450761+0000","scrub_duration":0.0016463960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"25'15","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:08.904884+0000","last_change":"2023-09-28T00:24:08.904837+0000","last_active":"2023-09-28T00:24:08.904884+0000","last_peered":"2023-09-28T00:24:08.904884+0000","last_clean":"2023-09-28T00:24:08.904884+0000","last_became_active":"2023-09-28T00:22:59.214069+0000","last_became_peered":"2023-09-28T00:22:59.214069+0000","last_unstale":"2023-09-28T00:24:08.904884+0000","last_undegraded":"2023-09-28T00:24:08.904884+0000","last_fullsized":"2023-09-28T00:24:08.904884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2023-09-28T00:24:08.904723+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2023-09-28T00:24:08.904723+0000","last_clean_scrub_stamp":"2023-09-28T00:24:08.904723+0000","objects_scrubbed":6,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:35.916715+0000","scrub_duration":0.0063761390000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.044593+0000","last_change":"2023-09-28T00:24:00.044566+0000","last_active":"2023-09-28T00:24:00.044593+0000","last_peered":"2023-09-28T00:24:00.044593+0000","last_clean":"2023-09-28T00:24:00.044593+0000","last_became_active":"2023-09-28T00:22:59.696875+0000","last_became_peered":"2023-09-28T00:22:59.696875+0000","last_unstale":"2023-09-28T00:24:00.044593+0000","last_undegraded":"2023-09-28T00:24:00.044593+0000","last_fullsized":"2023-09-28T00:24:00.044593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.044450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.044450+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.044450+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:27:05.463992+0000","scrub_duration":0.001578772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.143134+0000","last_change":"2023-09-28T00:23:35.143103+0000","last_active":"2023-09-28T00:23:35.143134+0000","last_peered":"2023-09-28T00:23:35.143134+0000","last_clean":"2023-09-28T00:23:35.143134+0000","last_became_active":"2023-09-28T00:22:59.203740+0000","last_became_peered":"2023-09-28T00:22:59.203740+0000","last_unstale":"2023-09-28T00:23:35.143134+0000","last_undegraded":"2023-09-28T00:23:35.143134+0000","last_fullsized":"2023-09-28T00:23:35.143134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:35.143009+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.143009+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:22.819982+0000","scrub_duration":0.0043366630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.077248+0000","last_change":"2023-09-28T00:23:44.077215+0000","last_active":"2023-09-28T00:23:44.077248+0000","last_peered":"2023-09-28T00:23:44.077248+0000","last_clean":"2023-09-28T00:23:44.077248+0000","last_became_active":"2023-09-28T00:22:59.716750+0000","last_became_peered":"2023-09-28T00:22:59.716750+0000","last_unstale":"2023-09-28T00:23:44.077248+0000","last_undegraded":"2023-09-28T00:23:44.077248+0000","last_fullsized":"2023-09-28T00:23:44.077248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.077114+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.077114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:31.423889+0000","scrub_duration":0.0016410789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.134927+0000","last_change":"2023-09-28T00:23:39.134889+0000","last_active":"2023-09-28T00:23:39.134927+0000","last_peered":"2023-09-28T00:23:39.134927+0000","last_clean":"2023-09-28T00:23:39.134927+0000","last_became_active":"2023-09-28T00:22:59.203322+0000","last_became_peered":"2023-09-28T00:22:59.203322+0000","last_unstale":"2023-09-28T00:23:39.134927+0000","last_undegraded":"2023-09-28T00:23:39.134927+0000","last_fullsized":"2023-09-28T00:23:39.134927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:39.134801+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.134801+0000","objects_scrubbed":3,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:08.531014+0000","scrub_duration":0.0043778289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:13.557796+0000","last_change":"2023-09-28T00:24:13.557759+0000","last_active":"2023-09-28T00:24:13.557796+0000","last_peered":"2023-09-28T00:24:13.557796+0000","last_clean":"2023-09-28T00:24:13.557796+0000","last_became_active":"2023-09-28T00:22:59.706121+0000","last_became_peered":"2023-09-28T00:22:59.706121+0000","last_unstale":"2023-09-28T00:24:13.557796+0000","last_undegraded":"2023-09-28T00:24:13.557796+0000","last_fullsized":"2023-09-28T00:24:13.557796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:13.557652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:13.557652+0000","last_clean_scrub_stamp":"2023-09-28T00:24:13.557652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:23.645373+0000","scrub_duration":0.001489579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'21","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.575210+0000","last_change":"2023-09-28T00:23:32.575182+0000","last_active":"2023-09-28T00:23:32.575210+0000","last_peered":"2023-09-28T00:23:32.575210+0000","last_clean":"2023-09-28T00:23:32.575210+0000","last_became_active":"2023-09-28T00:22:59.210047+0000","last_became_peered":"2023-09-28T00:22:59.210047+0000","last_unstale":"2023-09-28T00:23:32.575210+0000","last_undegraded":"2023-09-28T00:23:32.575210+0000","last_fullsized":"2023-09-28T00:23:32.575210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2023-09-28T00:23:32.575111+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.575111+0000","objects_scrubbed":8,"log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:28.818017+0000","scrub_duration":0.004538523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:08.543302+0000","last_change":"2023-09-28T00:24:08.543272+0000","last_active":"2023-09-28T00:24:08.543302+0000","last_peered":"2023-09-28T00:24:08.543302+0000","last_clean":"2023-09-28T00:24:08.543302+0000","last_became_active":"2023-09-28T00:22:59.706905+0000","last_became_peered":"2023-09-28T00:22:59.706905+0000","last_unstale":"2023-09-28T00:24:08.543302+0000","last_undegraded":"2023-09-28T00:24:08.543302+0000","last_fullsized":"2023-09-28T00:24:08.543302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:08.543160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:08.543160+0000","last_clean_scrub_stamp":"2023-09-28T00:24:08.543160+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:59.396943+0000","scrub_duration":0.0022213440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.319409+0000","last_change":"2023-09-28T00:23:29.319382+0000","last_active":"2023-09-28T00:23:29.319409+0000","last_peered":"2023-09-28T00:23:29.319409+0000","last_clean":"2023-09-28T00:23:29.319409+0000","last_became_active":"2023-09-28T00:22:59.217850+0000","last_became_peered":"2023-09-28T00:22:59.217850+0000","last_unstale":"2023-09-28T00:23:29.319409+0000","last_undegraded":"2023-09-28T00:23:29.319409+0000","last_fullsized":"2023-09-28T00:23:29.319409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:29.319298+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.319298+0000","objects_scrubbed":2,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:16:37.432115+0000","scrub_duration":0.002326229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:25.936361+0000","last_change":"2023-09-28T00:24:25.936328+0000","last_active":"2023-09-28T00:24:25.936361+0000","last_peered":"2023-09-28T00:24:25.936361+0000","last_clean":"2023-09-28T00:24:25.936361+0000","last_became_active":"2023-09-28T00:22:59.705968+0000","last_became_peered":"2023-09-28T00:22:59.705968+0000","last_unstale":"2023-09-28T00:24:25.936361+0000","last_undegraded":"2023-09-28T00:24:25.936361+0000","last_fullsized":"2023-09-28T00:24:25.936361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:25.936206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:25.936206+0000","last_clean_scrub_stamp":"2023-09-28T00:24:25.936206+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:25:47.065453+0000","scrub_duration":0.0016327830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.400420+0000","last_change":"2023-09-28T00:23:33.400388+0000","last_active":"2023-09-28T00:23:33.400420+0000","last_peered":"2023-09-28T00:23:33.400420+0000","last_clean":"2023-09-28T00:23:33.400420+0000","last_became_active":"2023-09-28T00:22:59.214825+0000","last_became_peered":"2023-09-28T00:22:59.214825+0000","last_unstale":"2023-09-28T00:23:33.400420+0000","last_undegraded":"2023-09-28T00:23:33.400420+0000","last_fullsized":"2023-09-28T00:23:33.400420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.400290+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.400290+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:16:32.293022+0000","scrub_duration":0.0031017280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.549752+0000","last_change":"2023-09-28T00:23:38.549684+0000","last_active":"2023-09-28T00:23:38.549752+0000","last_peered":"2023-09-28T00:23:38.549752+0000","last_clean":"2023-09-28T00:23:38.549752+0000","last_became_active":"2023-09-28T00:22:59.714222+0000","last_became_peered":"2023-09-28T00:22:59.714222+0000","last_unstale":"2023-09-28T00:23:38.549752+0000","last_undegraded":"2023-09-28T00:23:38.549752+0000","last_fullsized":"2023-09-28T00:23:38.549752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:38.549532+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.549532+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:38:59.086311+0000","scrub_duration":0.0020537279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.127159+0000","last_change":"2023-09-28T00:23:30.127112+0000","last_active":"2023-09-28T00:23:30.127159+0000","last_peered":"2023-09-28T00:23:30.127159+0000","last_clean":"2023-09-28T00:23:30.127159+0000","last_became_active":"2023-09-28T00:22:59.211687+0000","last_became_peered":"2023-09-28T00:22:59.211687+0000","last_unstale":"2023-09-28T00:23:30.127159+0000","last_undegraded":"2023-09-28T00:23:30.127159+0000","last_fullsized":"2023-09-28T00:23:30.127159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:30.127030+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.127030+0000","objects_scrubbed":1,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:50:58.393189+0000","scrub_duration":0.00305843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.345983+0000","last_change":"2023-09-28T00:23:43.345944+0000","last_active":"2023-09-28T00:23:43.345983+0000","last_peered":"2023-09-28T00:23:43.345983+0000","last_clean":"2023-09-28T00:23:43.345983+0000","last_became_active":"2023-09-28T00:22:59.719888+0000","last_became_peered":"2023-09-28T00:22:59.719888+0000","last_unstale":"2023-09-28T00:23:43.345983+0000","last_undegraded":"2023-09-28T00:23:43.345983+0000","last_fullsized":"2023-09-28T00:23:43.345983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.345844+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.345844+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:33:16.087415+0000","scrub_duration":0.0015894629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.278071+0000","last_change":"2023-09-28T00:23:33.278024+0000","last_active":"2023-09-28T00:23:33.278071+0000","last_peered":"2023-09-28T00:23:33.278071+0000","last_clean":"2023-09-28T00:23:33.278071+0000","last_became_active":"2023-09-28T00:22:59.217095+0000","last_became_peered":"2023-09-28T00:22:59.217095+0000","last_unstale":"2023-09-28T00:23:33.278071+0000","last_undegraded":"2023-09-28T00:23:33.278071+0000","last_fullsized":"2023-09-28T00:23:33.278071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:33.277933+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.277933+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:20.954905+0000","scrub_duration":0.0026154009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1094,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:53.434646+0000","last_change":"2023-09-28T00:23:53.434610+0000","last_active":"2023-09-28T00:23:53.434646+0000","last_peered":"2023-09-28T00:23:53.434646+0000","last_clean":"2023-09-28T00:23:53.434646+0000","last_became_active":"2023-09-28T00:22:59.697637+0000","last_became_peered":"2023-09-28T00:22:59.697637+0000","last_unstale":"2023-09-28T00:23:53.434646+0000","last_undegraded":"2023-09-28T00:23:53.434646+0000","last_fullsized":"2023-09-28T00:23:53.434646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:53.434474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:53.434474+0000","last_clean_scrub_stamp":"2023-09-28T00:23:53.434474+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:58.854016+0000","scrub_duration":0.0017684179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.958082+0000","last_change":"2023-09-28T00:23:36.958043+0000","last_active":"2023-09-28T00:23:36.958082+0000","last_peered":"2023-09-28T00:23:36.958082+0000","last_clean":"2023-09-28T00:23:36.958082+0000","last_became_active":"2023-09-28T00:22:59.202611+0000","last_became_peered":"2023-09-28T00:22:59.202611+0000","last_unstale":"2023-09-28T00:23:36.958082+0000","last_undegraded":"2023-09-28T00:23:36.958082+0000","last_fullsized":"2023-09-28T00:23:36.958082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:36.957909+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.957909+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:25:24.634881+0000","scrub_duration":0.0032571900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.135317+0000","last_change":"2023-09-28T00:23:42.135283+0000","last_active":"2023-09-28T00:23:42.135317+0000","last_peered":"2023-09-28T00:23:42.135317+0000","last_clean":"2023-09-28T00:23:42.135317+0000","last_became_active":"2023-09-28T00:22:59.710658+0000","last_became_peered":"2023-09-28T00:22:59.710658+0000","last_unstale":"2023-09-28T00:23:42.135317+0000","last_undegraded":"2023-09-28T00:23:42.135317+0000","last_fullsized":"2023-09-28T00:23:42.135317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.135184+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.135184+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:19.095098+0000","scrub_duration":0.001635837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.120381+0000","last_change":"2023-09-28T00:23:47.120329+0000","last_active":"2023-09-28T00:23:47.120381+0000","last_peered":"2023-09-28T00:23:47.120381+0000","last_clean":"2023-09-28T00:23:47.120381+0000","last_became_active":"2023-09-28T00:22:59.208890+0000","last_became_peered":"2023-09-28T00:22:59.208890+0000","last_unstale":"2023-09-28T00:23:47.120381+0000","last_undegraded":"2023-09-28T00:23:47.120381+0000","last_fullsized":"2023-09-28T00:23:47.120381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:47.120219+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.120219+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:52.539761+0000","scrub_duration":0.0039619049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:40.900195+0000","last_change":"2023-09-28T00:24:40.900158+0000","last_active":"2023-09-28T00:24:40.900195+0000","last_peered":"2023-09-28T00:24:40.900195+0000","last_clean":"2023-09-28T00:24:40.900195+0000","last_became_active":"2023-09-28T00:22:59.706721+0000","last_became_peered":"2023-09-28T00:22:59.706721+0000","last_unstale":"2023-09-28T00:24:40.900195+0000","last_undegraded":"2023-09-28T00:24:40.900195+0000","last_fullsized":"2023-09-28T00:24:40.900195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:40.900042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:40.900042+0000","last_clean_scrub_stamp":"2023-09-28T00:24:40.900042+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:19:40.715252+0000","scrub_duration":0.0016708879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'11","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:11.903877+0000","last_change":"2023-09-28T00:24:11.903841+0000","last_active":"2023-09-28T00:24:11.903877+0000","last_peered":"2023-09-28T00:24:11.903877+0000","last_clean":"2023-09-28T00:24:11.903877+0000","last_became_active":"2023-09-28T00:22:59.204391+0000","last_became_peered":"2023-09-28T00:22:59.204391+0000","last_unstale":"2023-09-28T00:24:11.903877+0000","last_undegraded":"2023-09-28T00:24:11.903877+0000","last_fullsized":"2023-09-28T00:24:11.903877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-09-28T00:24:11.903746+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-09-28T00:24:11.903746+0000","last_clean_scrub_stamp":"2023-09-28T00:24:11.903746+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:35:57.245024+0000","scrub_duration":0.0049177229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.299579+0000","last_change":"2023-09-28T00:23:56.299517+0000","last_active":"2023-09-28T00:23:56.299579+0000","last_peered":"2023-09-28T00:23:56.299579+0000","last_clean":"2023-09-28T00:23:56.299579+0000","last_became_active":"2023-09-28T00:22:59.718666+0000","last_became_peered":"2023-09-28T00:22:59.718666+0000","last_unstale":"2023-09-28T00:23:56.299579+0000","last_undegraded":"2023-09-28T00:23:56.299579+0000","last_fullsized":"2023-09-28T00:23:56.299579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.299388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.299388+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.299388+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:57.055926+0000","scrub_duration":0.0017635509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.085810+0000","last_change":"2023-09-28T00:23:35.085780+0000","last_active":"2023-09-28T00:23:35.085810+0000","last_peered":"2023-09-28T00:23:35.085810+0000","last_clean":"2023-09-28T00:23:35.085810+0000","last_became_active":"2023-09-28T00:22:59.205244+0000","last_became_peered":"2023-09-28T00:22:59.205244+0000","last_unstale":"2023-09-28T00:23:35.085810+0000","last_undegraded":"2023-09-28T00:23:35.085810+0000","last_fullsized":"2023-09-28T00:23:35.085810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2023-09-28T00:23:35.085669+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.085669+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:37.538489+0000","scrub_duration":0.0028376410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.992118+0000","last_change":"2023-09-28T00:23:47.992070+0000","last_active":"2023-09-28T00:23:47.992118+0000","last_peered":"2023-09-28T00:23:47.992118+0000","last_clean":"2023-09-28T00:23:47.992118+0000","last_became_active":"2023-09-28T00:22:59.699879+0000","last_became_peered":"2023-09-28T00:22:59.699879+0000","last_unstale":"2023-09-28T00:23:47.992118+0000","last_undegraded":"2023-09-28T00:23:47.992118+0000","last_fullsized":"2023-09-28T00:23:47.992118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.991945+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.991945+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:27.276590+0000","scrub_duration":0.0016691169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.390807+0000","last_change":"2023-09-28T00:23:32.390774+0000","last_active":"2023-09-28T00:23:32.390807+0000","last_peered":"2023-09-28T00:23:32.390807+0000","last_clean":"2023-09-28T00:23:32.390807+0000","last_became_active":"2023-09-28T00:22:54.431027+0000","last_became_peered":"2023-09-28T00:22:54.431027+0000","last_unstale":"2023-09-28T00:23:32.390807+0000","last_undegraded":"2023-09-28T00:23:32.390807+0000","last_fullsized":"2023-09-28T00:23:32.390807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:32.390659+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.390659+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:23.814089+0000","scrub_duration":0.001476237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:29.350385+0000","last_change":"2023-09-28T00:23:29.350352+0000","last_active":"2023-09-28T00:23:29.350385+0000","last_peered":"2023-09-28T00:23:29.350385+0000","last_clean":"2023-09-28T00:23:29.350385+0000","last_became_active":"2023-09-28T00:22:59.201097+0000","last_became_peered":"2023-09-28T00:22:59.201097+0000","last_unstale":"2023-09-28T00:23:29.350385+0000","last_undegraded":"2023-09-28T00:23:29.350385+0000","last_fullsized":"2023-09-28T00:23:29.350385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2023-09-28T00:23:29.350273+0000","last_clean_scrub_stamp":"2023-09-28T00:23:29.350273+0000","objects_scrubbed":3,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:06:24.282255+0000","scrub_duration":0.0024491669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:52.068310+0000","last_change":"2023-09-28T00:23:52.068250+0000","last_active":"2023-09-28T00:23:52.068310+0000","last_peered":"2023-09-28T00:23:52.068310+0000","last_clean":"2023-09-28T00:23:52.068310+0000","last_became_active":"2023-09-28T00:22:59.711319+0000","last_became_peered":"2023-09-28T00:22:59.711319+0000","last_unstale":"2023-09-28T00:23:52.068310+0000","last_undegraded":"2023-09-28T00:23:52.068310+0000","last_fullsized":"2023-09-28T00:23:52.068310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:52.068117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:52.068117+0000","last_clean_scrub_stamp":"2023-09-28T00:23:52.068117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:23:21.991783+0000","scrub_duration":0.001925312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:06.901921+0000","last_change":"2023-09-28T00:24:06.901889+0000","last_active":"2023-09-28T00:24:06.901921+0000","last_peered":"2023-09-28T00:24:06.901921+0000","last_clean":"2023-09-28T00:24:06.901921+0000","last_became_active":"2023-09-28T00:22:54.431106+0000","last_became_peered":"2023-09-28T00:22:54.431106+0000","last_unstale":"2023-09-28T00:24:06.901921+0000","last_undegraded":"2023-09-28T00:24:06.901921+0000","last_fullsized":"2023-09-28T00:24:06.901921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:06.901757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:06.901757+0000","last_clean_scrub_stamp":"2023-09-28T00:24:06.901757+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:16.989478+0000","scrub_duration":0.002189018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:30.293946+0000","last_change":"2023-09-28T00:23:30.293921+0000","last_active":"2023-09-28T00:23:30.293946+0000","last_peered":"2023-09-28T00:23:30.293946+0000","last_clean":"2023-09-28T00:23:30.293946+0000","last_became_active":"2023-09-28T00:22:59.211984+0000","last_became_peered":"2023-09-28T00:22:59.211984+0000","last_unstale":"2023-09-28T00:23:30.293946+0000","last_undegraded":"2023-09-28T00:23:30.293946+0000","last_fullsized":"2023-09-28T00:23:30.293946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:30.293841+0000","last_clean_scrub_stamp":"2023-09-28T00:23:30.293841+0000","objects_scrubbed":5,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:23.134625+0000","scrub_duration":0.002485498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.095642+0000","last_change":"2023-09-28T00:23:46.095610+0000","last_active":"2023-09-28T00:23:46.095642+0000","last_peered":"2023-09-28T00:23:46.095642+0000","last_clean":"2023-09-28T00:23:46.095642+0000","last_became_active":"2023-09-28T00:22:59.696011+0000","last_became_peered":"2023-09-28T00:22:59.696011+0000","last_unstale":"2023-09-28T00:23:46.095642+0000","last_undegraded":"2023-09-28T00:23:46.095642+0000","last_fullsized":"2023-09-28T00:23:46.095642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.095492+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.095492+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:25.380137+0000","scrub_duration":0.0014021330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.956906+0000","last_change":"2023-09-28T00:23:35.956877+0000","last_active":"2023-09-28T00:23:35.956906+0000","last_peered":"2023-09-28T00:23:35.956906+0000","last_clean":"2023-09-28T00:23:35.956906+0000","last_became_active":"2023-09-28T00:22:54.170732+0000","last_became_peered":"2023-09-28T00:22:54.170732+0000","last_unstale":"2023-09-28T00:23:35.956906+0000","last_undegraded":"2023-09-28T00:23:35.956906+0000","last_fullsized":"2023-09-28T00:23:35.956906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:35.956762+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.956762+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:06:10.265298+0000","scrub_duration":0.00159213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:35.385146+0000","last_change":"2023-09-28T00:23:35.385107+0000","last_active":"2023-09-28T00:23:35.385146+0000","last_peered":"2023-09-28T00:23:35.385146+0000","last_clean":"2023-09-28T00:23:35.385146+0000","last_became_active":"2023-09-28T00:22:59.202049+0000","last_became_peered":"2023-09-28T00:22:59.202049+0000","last_unstale":"2023-09-28T00:23:35.385146+0000","last_undegraded":"2023-09-28T00:23:35.385146+0000","last_fullsized":"2023-09-28T00:23:35.385146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:35.384999+0000","last_clean_scrub_stamp":"2023-09-28T00:23:35.384999+0000","objects_scrubbed":1,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:56.683879+0000","scrub_duration":0.003022407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.111930+0000","last_change":"2023-09-28T00:23:44.111895+0000","last_active":"2023-09-28T00:23:44.111930+0000","last_peered":"2023-09-28T00:23:44.111930+0000","last_clean":"2023-09-28T00:23:44.111930+0000","last_became_active":"2023-09-28T00:22:59.700971+0000","last_became_peered":"2023-09-28T00:22:59.700971+0000","last_unstale":"2023-09-28T00:23:44.111930+0000","last_undegraded":"2023-09-28T00:23:44.111930+0000","last_fullsized":"2023-09-28T00:23:44.111930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.111778+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.111778+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:21:21.071692+0000","scrub_duration":0.0020723899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:54.126803+0000","last_change":"2023-09-28T00:23:54.126756+0000","last_active":"2023-09-28T00:23:54.126803+0000","last_peered":"2023-09-28T00:23:54.126803+0000","last_clean":"2023-09-28T00:23:54.126803+0000","last_became_active":"2023-09-28T00:22:54.432140+0000","last_became_peered":"2023-09-28T00:22:54.432140+0000","last_unstale":"2023-09-28T00:23:54.126803+0000","last_undegraded":"2023-09-28T00:23:54.126803+0000","last_fullsized":"2023-09-28T00:23:54.126803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:54.126652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:54.126652+0000","last_clean_scrub_stamp":"2023-09-28T00:23:54.126652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:14.806389+0000","scrub_duration":0.0016744850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.534399+0000","last_change":"2023-09-28T00:23:31.534372+0000","last_active":"2023-09-28T00:23:31.534399+0000","last_peered":"2023-09-28T00:23:31.534399+0000","last_clean":"2023-09-28T00:23:31.534399+0000","last_became_active":"2023-09-28T00:22:46.817879+0000","last_became_peered":"2023-09-28T00:22:46.817879+0000","last_unstale":"2023-09-28T00:23:31.534399+0000","last_undegraded":"2023-09-28T00:23:31.534399+0000","last_fullsized":"2023-09-28T00:23:31.534399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2023-09-28T00:23:31.534296+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.534296+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:08:14.007270+0000","scrub_duration":0.0047438030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:37.142763+0000","last_change":"2023-09-28T00:23:37.142735+0000","last_active":"2023-09-28T00:23:37.142763+0000","last_peered":"2023-09-28T00:23:37.142763+0000","last_clean":"2023-09-28T00:23:37.142763+0000","last_became_active":"2023-09-28T00:22:59.205700+0000","last_became_peered":"2023-09-28T00:22:59.205700+0000","last_unstale":"2023-09-28T00:23:37.142763+0000","last_undegraded":"2023-09-28T00:23:37.142763+0000","last_fullsized":"2023-09-28T00:23:37.142763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:37.142635+0000","last_clean_scrub_stamp":"2023-09-28T00:23:37.142635+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:38:19.715678+0000","scrub_duration":0.0044461099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:36.979070+0000","last_change":"2023-09-28T00:24:36.979037+0000","last_active":"2023-09-28T00:24:36.979070+0000","last_peered":"2023-09-28T00:24:36.979070+0000","last_clean":"2023-09-28T00:24:36.979070+0000","last_became_active":"2023-09-28T00:22:59.706393+0000","last_became_peered":"2023-09-28T00:22:59.706393+0000","last_unstale":"2023-09-28T00:24:36.979070+0000","last_undegraded":"2023-09-28T00:24:36.979070+0000","last_fullsized":"2023-09-28T00:24:36.979070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:36.978928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:36.978928+0000","last_clean_scrub_stamp":"2023-09-28T00:24:36.978928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:22:40.135662+0000","scrub_duration":0.001749277,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.989229+0000","last_change":"2023-09-28T00:24:01.989195+0000","last_active":"2023-09-28T00:24:01.989229+0000","last_peered":"2023-09-28T00:24:01.989229+0000","last_clean":"2023-09-28T00:24:01.989229+0000","last_became_active":"2023-09-28T00:22:54.171156+0000","last_became_peered":"2023-09-28T00:22:54.171156+0000","last_unstale":"2023-09-28T00:24:01.989229+0000","last_undegraded":"2023-09-28T00:24:01.989229+0000","last_fullsized":"2023-09-28T00:24:01.989229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.989085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.989085+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.989085+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:38:52.842868+0000","scrub_duration":0.0023898869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:32.146002+0000","last_change":"2023-09-28T00:23:32.145963+0000","last_active":"2023-09-28T00:23:32.146002+0000","last_peered":"2023-09-28T00:23:32.146002+0000","last_clean":"2023-09-28T00:23:32.146002+0000","last_became_active":"2023-09-28T00:22:59.207384+0000","last_became_peered":"2023-09-28T00:22:59.207384+0000","last_unstale":"2023-09-28T00:23:32.146002+0000","last_undegraded":"2023-09-28T00:23:32.146002+0000","last_fullsized":"2023-09-28T00:23:32.146002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2023-09-28T00:23:32.145842+0000","last_clean_scrub_stamp":"2023-09-28T00:23:32.145842+0000","objects_scrubbed":3,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:04:24.986625+0000","scrub_duration":0.0025902830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:46.442472+0000","last_change":"2023-09-28T00:23:46.442444+0000","last_active":"2023-09-28T00:23:46.442472+0000","last_peered":"2023-09-28T00:23:46.442472+0000","last_clean":"2023-09-28T00:23:46.442472+0000","last_became_active":"2023-09-28T00:22:59.700714+0000","last_became_peered":"2023-09-28T00:22:59.700714+0000","last_unstale":"2023-09-28T00:23:46.442472+0000","last_undegraded":"2023-09-28T00:23:46.442472+0000","last_fullsized":"2023-09-28T00:23:46.442472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:46.442331+0000","last_clean_scrub_stamp":"2023-09-28T00:23:46.442331+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:15.838545+0000","scrub_duration":0.0013918260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:50.123742+0000","last_change":"2023-09-28T00:23:50.123709+0000","last_active":"2023-09-28T00:23:50.123742+0000","last_peered":"2023-09-28T00:23:50.123742+0000","last_clean":"2023-09-28T00:23:50.123742+0000","last_became_active":"2023-09-28T00:22:54.171125+0000","last_became_peered":"2023-09-28T00:22:54.171125+0000","last_unstale":"2023-09-28T00:23:50.123742+0000","last_undegraded":"2023-09-28T00:23:50.123742+0000","last_fullsized":"2023-09-28T00:23:50.123742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:50.123604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:50.123604+0000","last_clean_scrub_stamp":"2023-09-28T00:23:50.123604+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:30:07.047896+0000","scrub_duration":0.0020728830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:38.160690+0000","last_change":"2023-09-28T00:23:38.160661+0000","last_active":"2023-09-28T00:23:38.160690+0000","last_peered":"2023-09-28T00:23:38.160690+0000","last_clean":"2023-09-28T00:23:38.160690+0000","last_became_active":"2023-09-28T00:22:59.201116+0000","last_became_peered":"2023-09-28T00:22:59.201116+0000","last_unstale":"2023-09-28T00:23:38.160690+0000","last_undegraded":"2023-09-28T00:23:38.160690+0000","last_fullsized":"2023-09-28T00:23:38.160690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2023-09-28T00:23:38.160543+0000","last_clean_scrub_stamp":"2023-09-28T00:23:38.160543+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:29.583972+0000","scrub_duration":0.0015551149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:43.149982+0000","last_change":"2023-09-28T00:23:43.149946+0000","last_active":"2023-09-28T00:23:43.149982+0000","last_peered":"2023-09-28T00:23:43.149982+0000","last_clean":"2023-09-28T00:23:43.149982+0000","last_became_active":"2023-09-28T00:22:59.701911+0000","last_became_peered":"2023-09-28T00:22:59.701911+0000","last_unstale":"2023-09-28T00:23:43.149982+0000","last_undegraded":"2023-09-28T00:23:43.149982+0000","last_fullsized":"2023-09-28T00:23:43.149982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:43.149846+0000","last_clean_scrub_stamp":"2023-09-28T00:23:43.149846+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:45.602666+0000","scrub_duration":0.0019646730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"25'11","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:45.073095+0000","last_change":"2023-09-28T00:23:45.073062+0000","last_active":"2023-09-28T00:23:45.073095+0000","last_peered":"2023-09-28T00:23:45.073095+0000","last_clean":"2023-09-28T00:23:45.073095+0000","last_became_active":"2023-09-28T00:22:59.203726+0000","last_became_peered":"2023-09-28T00:22:59.203726+0000","last_unstale":"2023-09-28T00:23:45.073095+0000","last_undegraded":"2023-09-28T00:23:45.073095+0000","last_fullsized":"2023-09-28T00:23:45.073095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2023-09-28T00:23:45.072959+0000","last_clean_scrub_stamp":"2023-09-28T00:23:45.072959+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:57:14.469172+0000","scrub_duration":0.0043027669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:31.049288+0000","last_change":"2023-09-28T00:23:31.049243+0000","last_active":"2023-09-28T00:23:31.049288+0000","last_peered":"2023-09-28T00:23:31.049288+0000","last_clean":"2023-09-28T00:23:31.049288+0000","last_became_active":"2023-09-28T00:22:54.171001+0000","last_became_peered":"2023-09-28T00:22:54.171001+0000","last_unstale":"2023-09-28T00:23:31.049288+0000","last_undegraded":"2023-09-28T00:23:31.049288+0000","last_fullsized":"2023-09-28T00:23:31.049288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:31.049126+0000","last_clean_scrub_stamp":"2023-09-28T00:23:31.049126+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:46:22.472556+0000","scrub_duration":0.0016726429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:12.242919+0000","last_change":"2023-09-28T00:24:12.242887+0000","last_active":"2023-09-28T00:24:12.242919+0000","last_peered":"2023-09-28T00:24:12.242919+0000","last_clean":"2023-09-28T00:24:12.242919+0000","last_became_active":"2023-09-28T00:22:59.721703+0000","last_became_peered":"2023-09-28T00:22:59.721703+0000","last_unstale":"2023-09-28T00:24:12.242919+0000","last_undegraded":"2023-09-28T00:24:12.242919+0000","last_fullsized":"2023-09-28T00:24:12.242919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:12.242752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:12.242752+0000","last_clean_scrub_stamp":"2023-09-28T00:24:12.242752+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:22.330472+0000","scrub_duration":0.002465381,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:01.025569+0000","last_change":"2023-09-28T00:24:01.025536+0000","last_active":"2023-09-28T00:24:01.025569+0000","last_peered":"2023-09-28T00:24:01.025569+0000","last_clean":"2023-09-28T00:24:01.025569+0000","last_became_active":"2023-09-28T00:22:54.171828+0000","last_became_peered":"2023-09-28T00:22:54.171828+0000","last_unstale":"2023-09-28T00:24:01.025569+0000","last_undegraded":"2023-09-28T00:24:01.025569+0000","last_fullsized":"2023-09-28T00:24:01.025569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:01.025433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:01.025433+0000","last_clean_scrub_stamp":"2023-09-28T00:24:01.025433+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:13:53.764764+0000","scrub_duration":0.0016622360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:34.084444+0000","last_change":"2023-09-28T00:23:34.084410+0000","last_active":"2023-09-28T00:23:34.084444+0000","last_peered":"2023-09-28T00:23:34.084444+0000","last_clean":"2023-09-28T00:23:34.084444+0000","last_became_active":"2023-09-28T00:22:59.205166+0000","last_became_peered":"2023-09-28T00:22:59.205166+0000","last_unstale":"2023-09-28T00:23:34.084444+0000","last_undegraded":"2023-09-28T00:23:34.084444+0000","last_fullsized":"2023-09-28T00:23:34.084444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2023-09-28T00:23:34.084301+0000","last_clean_scrub_stamp":"2023-09-28T00:23:34.084301+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:25:55.383181+0000","scrub_duration":0.003197971,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:42.323131+0000","last_change":"2023-09-28T00:23:42.323097+0000","last_active":"2023-09-28T00:23:42.323131+0000","last_peered":"2023-09-28T00:23:42.323131+0000","last_clean":"2023-09-28T00:23:42.323131+0000","last_became_active":"2023-09-28T00:22:59.718710+0000","last_became_peered":"2023-09-28T00:22:59.718710+0000","last_unstale":"2023-09-28T00:23:42.323131+0000","last_undegraded":"2023-09-28T00:23:42.323131+0000","last_fullsized":"2023-09-28T00:23:42.323131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:42.322988+0000","last_clean_scrub_stamp":"2023-09-28T00:23:42.322988+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:21:38.153260+0000","scrub_duration":0.0016894810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'7","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:39.081883+0000","last_change":"2023-09-28T00:23:39.081826+0000","last_active":"2023-09-28T00:23:39.081883+0000","last_peered":"2023-09-28T00:23:39.081883+0000","last_clean":"2023-09-28T00:23:39.081883+0000","last_became_active":"2023-09-28T00:22:59.217788+0000","last_became_peered":"2023-09-28T00:22:59.217788+0000","last_unstale":"2023-09-28T00:23:39.081883+0000","last_undegraded":"2023-09-28T00:23:39.081883+0000","last_fullsized":"2023-09-28T00:23:39.081883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-09-28T00:23:39.081717+0000","last_clean_scrub_stamp":"2023-09-28T00:23:39.081717+0000","objects_scrubbed":2,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:03.473134+0000","scrub_duration":0.0047997099999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:52.019821+0000","last_change":"2023-09-28T00:23:52.019791+0000","last_active":"2023-09-28T00:23:52.019821+0000","last_peered":"2023-09-28T00:23:52.019821+0000","last_clean":"2023-09-28T00:23:52.019821+0000","last_became_active":"2023-09-28T00:22:59.704312+0000","last_became_peered":"2023-09-28T00:22:59.704312+0000","last_unstale":"2023-09-28T00:23:52.019821+0000","last_undegraded":"2023-09-28T00:23:52.019821+0000","last_fullsized":"2023-09-28T00:23:52.019821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:52.019665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:52.019665+0000","last_clean_scrub_stamp":"2023-09-28T00:23:52.019665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:57.439207+0000","scrub_duration":0.001523052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'6","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.608016+0000","last_change":"2023-09-28T00:23:33.607964+0000","last_active":"2023-09-28T00:23:33.608016+0000","last_peered":"2023-09-28T00:23:33.608016+0000","last_clean":"2023-09-28T00:23:33.608016+0000","last_became_active":"2023-09-28T00:22:59.221095+0000","last_became_peered":"2023-09-28T00:22:59.221095+0000","last_unstale":"2023-09-28T00:23:33.608016+0000","last_undegraded":"2023-09-28T00:23:33.608016+0000","last_fullsized":"2023-09-28T00:23:33.608016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2023-09-28T00:23:33.607850+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.607850+0000","objects_scrubbed":3,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:18:45.641882+0000","scrub_duration":0.003579807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.287201+0000","last_change":"2023-09-28T00:24:00.287167+0000","last_active":"2023-09-28T00:24:00.287201+0000","last_peered":"2023-09-28T00:24:00.287201+0000","last_clean":"2023-09-28T00:24:00.287201+0000","last_became_active":"2023-09-28T00:22:59.706961+0000","last_became_peered":"2023-09-28T00:22:59.706961+0000","last_unstale":"2023-09-28T00:24:00.287201+0000","last_undegraded":"2023-09-28T00:24:00.287201+0000","last_fullsized":"2023-09-28T00:24:00.287201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.287064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.287064+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.287064+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:44:09.090387+0000","scrub_duration":0.0020295830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"25'13","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:33.069809+0000","last_change":"2023-09-28T00:23:33.069768+0000","last_active":"2023-09-28T00:23:33.069809+0000","last_peered":"2023-09-28T00:23:33.069809+0000","last_clean":"2023-09-28T00:23:33.069809+0000","last_became_active":"2023-09-28T00:22:59.217874+0000","last_became_peered":"2023-09-28T00:22:59.217874+0000","last_unstale":"2023-09-28T00:23:33.069809+0000","last_undegraded":"2023-09-28T00:23:33.069809+0000","last_fullsized":"2023-09-28T00:23:33.069809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2023-09-28T00:23:33.069686+0000","last_clean_scrub_stamp":"2023-09-28T00:23:33.069686+0000","objects_scrubbed":7,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:46:12.354331+0000","scrub_duration":0.0030685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:57.292546+0000","last_change":"2023-09-28T00:23:57.292511+0000","last_active":"2023-09-28T00:23:57.292546+0000","last_peered":"2023-09-28T00:23:57.292546+0000","last_clean":"2023-09-28T00:23:57.292546+0000","last_became_active":"2023-09-28T00:22:59.711230+0000","last_became_peered":"2023-09-28T00:22:59.711230+0000","last_unstale":"2023-09-28T00:23:57.292546+0000","last_undegraded":"2023-09-28T00:23:57.292546+0000","last_fullsized":"2023-09-28T00:23:57.292546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:57.292416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:57.292416+0000","last_clean_scrub_stamp":"2023-09-28T00:23:57.292416+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:24:59.948351+0000","scrub_duration":0.002143608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:36.390499+0000","last_change":"2023-09-28T00:23:36.390460+0000","last_active":"2023-09-28T00:23:36.390499+0000","last_peered":"2023-09-28T00:23:36.390499+0000","last_clean":"2023-09-28T00:23:36.390499+0000","last_became_active":"2023-09-28T00:22:59.200692+0000","last_became_peered":"2023-09-28T00:22:59.200692+0000","last_unstale":"2023-09-28T00:23:36.390499+0000","last_undegraded":"2023-09-28T00:23:36.390499+0000","last_fullsized":"2023-09-28T00:23:36.390499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2023-09-28T00:23:36.390358+0000","last_clean_scrub_stamp":"2023-09-28T00:23:36.390358+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:38.843177+0000","scrub_duration":0.002166659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:44.911467+0000","last_change":"2023-09-28T00:23:44.911437+0000","last_active":"2023-09-28T00:23:44.911467+0000","last_peered":"2023-09-28T00:23:44.911467+0000","last_clean":"2023-09-28T00:23:44.911467+0000","last_became_active":"2023-09-28T00:22:59.701162+0000","last_became_peered":"2023-09-28T00:22:59.701162+0000","last_unstale":"2023-09-28T00:23:44.911467+0000","last_undegraded":"2023-09-28T00:23:44.911467+0000","last_fullsized":"2023-09-28T00:23:44.911467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:44.911323+0000","last_clean_scrub_stamp":"2023-09-28T00:23:44.911323+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:47.364143+0000","scrub_duration":0.001669542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'19","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.462441+0000","last_change":"2023-09-28T00:23:40.462404+0000","last_active":"2023-09-28T00:23:40.462441+0000","last_peered":"2023-09-28T00:23:40.462441+0000","last_clean":"2023-09-28T00:23:40.462441+0000","last_became_active":"2023-09-28T00:22:59.207184+0000","last_became_peered":"2023-09-28T00:22:59.207184+0000","last_unstale":"2023-09-28T00:23:40.462441+0000","last_undegraded":"2023-09-28T00:23:40.462441+0000","last_fullsized":"2023-09-28T00:23:40.462441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2023-09-28T00:23:40.462229+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.462229+0000","objects_scrubbed":6,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:58:04.853646+0000","scrub_duration":0.0064632149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:47.416065+0000","last_change":"2023-09-28T00:23:47.416035+0000","last_active":"2023-09-28T00:23:47.416065+0000","last_peered":"2023-09-28T00:23:47.416065+0000","last_clean":"2023-09-28T00:23:47.416065+0000","last_became_active":"2023-09-28T00:22:59.708751+0000","last_became_peered":"2023-09-28T00:22:59.708751+0000","last_unstale":"2023-09-28T00:23:47.416065+0000","last_undegraded":"2023-09-28T00:23:47.416065+0000","last_fullsized":"2023-09-28T00:23:47.416065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:47.415939+0000","last_clean_scrub_stamp":"2023-09-28T00:23:47.415939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:32:46.034885+0000","scrub_duration":0.001829188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:57.495699+0000","last_change":"2023-09-28T00:23:57.495668+0000","last_active":"2023-09-28T00:23:57.495699+0000","last_peered":"2023-09-28T00:23:57.495699+0000","last_clean":"2023-09-28T00:23:57.495699+0000","last_became_active":"2023-09-28T00:22:59.701442+0000","last_became_peered":"2023-09-28T00:22:59.701442+0000","last_unstale":"2023-09-28T00:23:57.495699+0000","last_undegraded":"2023-09-28T00:23:57.495699+0000","last_fullsized":"2023-09-28T00:23:57.495699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:57.495535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:57.495535+0000","last_clean_scrub_stamp":"2023-09-28T00:23:57.495535+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:44:06.298858+0000","scrub_duration":0.0018793880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:56.993763+0000","last_change":"2023-09-28T00:23:56.993721+0000","last_active":"2023-09-28T00:23:56.993763+0000","last_peered":"2023-09-28T00:23:56.993763+0000","last_clean":"2023-09-28T00:23:56.993763+0000","last_became_active":"2023-09-28T00:22:59.699478+0000","last_became_peered":"2023-09-28T00:22:59.699478+0000","last_unstale":"2023-09-28T00:23:56.993763+0000","last_undegraded":"2023-09-28T00:23:56.993763+0000","last_fullsized":"2023-09-28T00:23:56.993763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:56.993610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:56.993610+0000","last_clean_scrub_stamp":"2023-09-28T00:23:56.993610+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:04:44.340385+0000","scrub_duration":0.0017574419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:23:40.135639+0000","last_change":"2023-09-28T00:23:40.135600+0000","last_active":"2023-09-28T00:23:40.135639+0000","last_peered":"2023-09-28T00:23:40.135639+0000","last_clean":"2023-09-28T00:23:40.135639+0000","last_became_active":"2023-09-28T00:22:59.723244+0000","last_became_peered":"2023-09-28T00:22:59.723244+0000","last_unstale":"2023-09-28T00:23:40.135639+0000","last_undegraded":"2023-09-28T00:23:40.135639+0000","last_fullsized":"2023-09-28T00:23:40.135639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:23:40.135470+0000","last_clean_scrub_stamp":"2023-09-28T00:23:40.135470+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:26:01.434350+0000","scrub_duration":0.0016553480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:00.483832+0000","last_change":"2023-09-28T00:24:00.483782+0000","last_active":"2023-09-28T00:24:00.483832+0000","last_peered":"2023-09-28T00:24:00.483832+0000","last_clean":"2023-09-28T00:24:00.483832+0000","last_became_active":"2023-09-28T00:22:59.707630+0000","last_became_peered":"2023-09-28T00:22:59.707630+0000","last_unstale":"2023-09-28T00:24:00.483832+0000","last_undegraded":"2023-09-28T00:24:00.483832+0000","last_fullsized":"2023-09-28T00:24:00.483832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:00.483673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:00.483673+0000","last_clean_scrub_stamp":"2023-09-28T00:24:00.483673+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:56:21.163409+0000","scrub_duration":0.0023254560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:24:07.544107+0000","last_change":"2023-09-28T00:24:07.544081+0000","last_active":"2023-09-28T00:24:07.544107+0000","last_peered":"2023-09-28T00:24:07.544107+0000","last_clean":"2023-09-28T00:24:07.544107+0000","last_became_active":"2023-09-28T00:22:59.706776+0000","last_became_peered":"2023-09-28T00:22:59.706776+0000","last_unstale":"2023-09-28T00:24:07.544107+0000","last_undegraded":"2023-09-28T00:24:07.544107+0000","last_fullsized":"2023-09-28T00:24:07.544107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:24:07.543963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:24:07.543963+0000","last_clean_scrub_stamp":"2023-09-28T00:24:07.543963+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:14:00.283294+0000","scrub_duration":0.0018712030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7626,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24400,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":15252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":238,"ondisk_log_size":238,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12272,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359568,"statfs":{"total":96636764160,"available":96624197632,"internally_reserved":0,"allocated":303104,"data_stored":99535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.62,"5min":1.371,"15min":1.371},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.872,"5min":1.02,"15min":1.02},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59499999999999997,"15min":0.61299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68100000000000005,"5min":1.865,"15min":1.865},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.753,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.41799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88100000000000001,"5min":1.026,"15min":1.026},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72999999999999998,"5min":1.903,"15min":1.903},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.61899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0049999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.58499999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.90400000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.80900000000000005,"15min":0.81499999999999995},"min":{"1min":0.64500000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":1.788,"15min":1.788},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.627,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95399999999999996,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81799999999999995,"15min":0.82399999999999995},"min":{"1min":0.64300000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.98099999999999998,"5min":1.571,"15min":1.571},"last":0.873},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.113,"15min":1.113},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.61299999999999999,"5min":0.503,"15min":0.503},"max":{"1min":0.95499999999999996,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.84599999999999997},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92200000000000004,"5min":1.827,"15min":1.827},"last":0.91000000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13348,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358492,"statfs":{"total":96636764160,"available":96623095808,"internally_reserved":0,"allocated":880640,"data_stored":688397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.49099999999999999,"15min":0.48199999999999998},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78300000000000003,"5min":1.002,"15min":1.002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.622,"15min":0.63600000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72799999999999998,"5min":2.573,"15min":2.573},"last":0.501}]},{"osd":2,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.66200000000000003,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80100000000000005,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95299999999999996,"5min":1.448,"15min":1.448},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89400000000000002,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.97799999999999998,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.123,"15min":1.123},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81299999999999994,"15min":0.81599999999999995},"min":{"1min":0.58699999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":1.421,"15min":1.421},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.84199999999999997,"15min":0.85299999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.016,"5min":2.786,"15min":2.786},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.83799999999999997,"15min":0.84299999999999997},"min":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.98699999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.014,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Sep 28 00:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85499999999999998,"15min":0.85699999999999998},"min":{"1min":0.628,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0840000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.87,"15min":0.878},"min":{"1min":0.63500000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.018,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.63500000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12400,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359440,"statfs":{"total":96636764160,"available":96624066560,"internally_reserved":0,"allocated":303104,"data_stored":99201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77000000000000002,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78800000000000003,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84899999999999998,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.62,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95699999999999996,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83499999999999996,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.61899999999999999,"15min":0.628},"min":{"1min":0.42999999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72599999999999998,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.56899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91200000000000003,"5min":1.321,"15min":1.321},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.65200000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98599999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":1.526,"15min":1.526},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.85899999999999999,"5min":1.821,"15min":1.821},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78300000000000003},"min":{"1min":0.68100000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95299999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.016},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.625,"5min":0.503,"15min":0.503},"max":{"1min":0.997,"5min":1.468,"15min":1.468},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.59099999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":1.871,"15min":1.871},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98099999999999998,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.98799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12276,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359564,"statfs":{"total":96636764160,"available":96624193536,"internally_reserved":0,"allocated":307200,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Sep 28 00:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.46100000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81799999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96899999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.99399999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.56799999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96099999999999997,"5min":1.141,"15min":1.141},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.262,"15min":1.262},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.55000000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.93700000000000006,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81399999999999995,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95699999999999996,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84299999999999997,"15min":0.84899999999999998},"min":{"1min":0.65100000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0009999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83899999999999997,"15min":0.84699999999999998},"min":{"1min":0.61599999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0229999999999999,"5min":1.375,"15min":1.375},"last":0.92900000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":97721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.437},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.48399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.60099999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80800000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76900000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.57399999999999995,"15min":0.56599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84299999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.50600000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.83099999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.438,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.44800000000000001},"min":{"1min":0.34999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32000000000000001}]},{"osd":6,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.497},"min":{"1min":0.37,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65800000000000003,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.49299999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":97853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.47699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88400000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.623}]},{"osd":1,"last update":"Thu Sep 28 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78400000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.438,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Sep 28 00:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.56000000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.86099999999999999,"5min":1.097,"15min":1.097},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.55900000000000005,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63100000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33000000000000002}]},{"osd":6,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70699999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.58499999999999996,"15min":0.59799999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67200000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61599999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.627,"15min":0.64300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.439}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13348,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358492,"statfs":{"total":96636764160,"available":96623095808,"internally_reserved":0,"allocated":880640,"data_stored":688485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.51900000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.44700000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58499999999999996,"15min":0.57299999999999995},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.52900000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.58499999999999996},"min":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.53000000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59399999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":0.995,"15min":0.995},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.376}]},{"osd":7,"last update":"Thu Sep 28 00:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65700000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":98161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.51900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88500000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Sep 28 00:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.53900000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.90900000000000003,"5min":1.069,"15min":1.069},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82299999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47599999999999998,"15min":0.48299999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.502}]},{"osd":5,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51100000000000001,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.58299999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Sep 28 00:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69799999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:24:54.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-28T00:24:54.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.665+0000 7f512e79d700 1 Processor -- start 2023-09-28T00:24:54.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.665+0000 7f512e79d700 1 -- start start 2023-09-28T00:24:54.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.666+0000 7f512e79d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51280c11e0 0x7f5128159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512e79d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5128156040 con 0x7f512813ed20 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512e79d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51280c6cf0 con 0x7f51280c0e10 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512e79d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51280c6730 con 0x7f51280c11e0 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512cf9a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51280c11e0 0x7f5128159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512d79b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f51280c0e10 0x7f512813e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:49896/0 (socket says 172.21.15.53:49896) 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512d79b700 1 -- 172.21.15.53:0/1649555083 learned_addr learned my addr 172.21.15.53:0/1649555083 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512df9c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f512813ed20 0x7f51281601a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59980/0 (socket says 172.21.15.53:59980) 2023-09-28T00:24:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070880869 0 0) 0x7f51280c6cf0 con 0x7f51280c0e10 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5114003570 con 0x7f51280c0e10 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284121989 0 0) 0x7f5128156040 con 0x7f512813ed20 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51280c6cf0 con 0x7f512813ed20 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512cf9a700 1 -- 172.21.15.53:0/1649555083 >> v1:172.21.15.118:6789/0 conn(0x7f51280c0e10 legacy=0x7f512813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512cf9a700 1 -- 172.21.15.53:0/1649555083 >> v1:172.21.15.53:6789/0 conn(0x7f512813ed20 legacy=0x7f51281601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.667+0000 7f512cf9a700 1 -- 172.21.15.53:0/1649555083 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280c6a10 con 0x7f51280c11e0 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f512cf9a700 1 --2- 172.21.15.53:0/1649555083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51280c11e0 0x7f5128159840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51180098e0 tx=0x7f51180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08c363d284c9d19 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:54.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118011630 con 0x7f51280c11e0 2023-09-28T00:24:54.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118011790 con 0x7f51280c11e0 2023-09-28T00:24:54.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f511ffff700 1 -- 172.21.15.53:0/1649555083 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118011b30 con 0x7f51280c11e0 2023-09-28T00:24:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f512e79d700 1 -- 172.21.15.53:0/1649555083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51280c11e0 msgr2=0x7f5128159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f512e79d700 1 --2- 172.21.15.53:0/1649555083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51280c11e0 0x7f5128159840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51180098e0 tx=0x7f51180091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f512e79d700 1 -- 172.21.15.53:0/1649555083 shutdown_connections 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f512e79d700 1 --2- 172.21.15.53:0/1649555083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51280c11e0 0x7f5128159840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.668+0000 7f512e79d700 1 -- 172.21.15.53:0/1649555083 >> 172.21.15.53:0/1649555083 conn(0x7f512806f830 msgr2=0x7f51280cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.669+0000 7f512e79d700 1 -- 172.21.15.53:0/1649555083 shutdown_connections 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.669+0000 7f512e79d700 1 -- 172.21.15.53:0/1649555083 wait complete. 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.670+0000 7f512e79d700 1 Processor -- start 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.670+0000 7f512e79d700 1 -- start start 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512e79d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51280c0e10 0x7f5128150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512e79d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 0x7f5128151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512e79d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f512813ed20 0x7f51281690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512e79d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512813aff0 con 0x7f51280c11e0 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512e79d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512813b2b0 con 0x7f512813ed20 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512e79d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512813a120 con 0x7f51280c0e10 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512cf9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 0x7f5128151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512cf9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 0x7f5128151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54250/0 (socket says 172.21.15.53:54250) 2023-09-28T00:24:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512cf9a700 1 -- 172.21.15.53:0/3606553885 learned_addr learned my addr 172.21.15.53:0/3606553885 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512d79b700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51280c0e10 0x7f5128150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.671+0000 7f512df9c700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f512813ed20 0x7f51281690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512cf9a700 1 -- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51280c0e10 msgr2=0x7f5128150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512cf9a700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51280c0e10 0x7f5128150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512cf9a700 1 -- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f512813ed20 msgr2=0x7f51281690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512cf9a700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f512813ed20 0x7f51281690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512cf9a700 1 -- 172.21.15.53:0/3606553885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118009420 con 0x7f51280c11e0 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512cf9a700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 0x7f5128151190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f512806a720 tx=0x7f5118017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511801f070 con 0x7f51280c11e0 2023-09-28T00:24:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118000bc0 con 0x7f51280c11e0 2023-09-28T00:24:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118025420 con 0x7f51280c11e0 2023-09-28T00:24:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512813a400 con 0x7f51280c11e0 2023-09-28T00:24:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.672+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128139680 con 0x7f51280c11e0 2023-09-28T00:24:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.674+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128139840 con 0x7f51280c11e0 2023-09-28T00:24:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.674+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5118023070 con 0x7f51280c11e0 2023-09-28T00:24:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.675+0000 7f511d7fa700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f510c067330 0x7f510c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.675+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5118085ec0 con 0x7f51280c11e0 2023-09-28T00:24:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.676+0000 7f512d79b700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f510c067330 0x7f510c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:54.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.676+0000 7f512d79b700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f510c067330 0x7f510c0697e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5124007fd0 tx=0x7f5124009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:54.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.679+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5118052dc0 con 0x7f51280c11e0 2023-09-28T00:24:54.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.882+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f512804c3c0 con 0x7f51280c11e0 2023-09-28T00:24:54.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.885+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f51180092a0 con 0x7f51280c11e0 2023-09-28T00:24:54.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.886+0000 7f511d7fa700 1 -- 172.21.15.53:0/3606553885 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f51180150c0 con 0x7f51280c11e0 2023-09-28T00:24:54.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f510c067330 msgr2=0x7f510c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f510c067330 0x7f510c0697e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5124007fd0 tx=0x7f5124009040 comp rx=0 tx=0).stop 2023-09-28T00:24:54.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 msgr2=0x7f5128151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:54.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 0x7f5128151190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f512806a720 tx=0x7f5118017000 comp rx=0 tx=0).stop 2023-09-28T00:24:54.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 shutdown_connections 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f510c067330 0x7f510c0697e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51280c0e10 0x7f5128150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f512813ed20 0x7f51281690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 --2- 172.21.15.53:0/3606553885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51280c11e0 0x7f5128151190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.888+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 >> 172.21.15.53:0/3606553885 conn(0x7f512806f830 msgr2=0x7f5128153600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.889+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 shutdown_connections 2023-09-28T00:24:54.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:54.889+0000 7f512e79d700 1 -- 172.21.15.53:0/3606553885 wait complete. 2023-09-28T00:24:54.905 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-28T00:24:54.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:24:55.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.094+0000 7f17d179d700 1 Processor -- start 2023-09-28T00:24:55.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.094+0000 7f17d179d700 1 -- start start 2023-09-28T00:24:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.095+0000 7f17d179d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17cc0add50 0x7f17cc1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.095+0000 7f17d179d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17cc069ca0 0x7f17cc06a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.095+0000 7f17d179d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0ccaa0 con 0x7f17cc0cc560 2023-09-28T00:24:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.095+0000 7f17d179d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0ae830 con 0x7f17cc069ca0 2023-09-28T00:24:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.095+0000 7f17d179d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc068c00 con 0x7f17cc0add50 2023-09-28T00:24:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17cc069ca0 0x7f17cc06a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17cb7fe700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f17cc0cc560 0x7f17cc0ae120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59986/0 (socket says 172.21.15.53:59986) 2023-09-28T00:24:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17cc069ca0 0x7f17cc06a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54258/0 (socket says 172.21.15.53:54258) 2023-09-28T00:24:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17cb7fe700 1 -- 172.21.15.53:0/1770109087 learned_addr learned my addr 172.21.15.53:0/1770109087 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17cbfff700 1 --2- 172.21.15.53:0/1770109087 >> v2:172.21.15.118:3300/0 conn(0x7f17cc0add50 0x7f17cc1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 -- 172.21.15.53:0/1770109087 >> v2:172.21.15.118:3300/0 conn(0x7f17cc0add50 msgr2=0x7f17cc1560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 --2- 172.21.15.53:0/1770109087 >> v2:172.21.15.118:3300/0 conn(0x7f17cc0add50 0x7f17cc1560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 -- 172.21.15.53:0/1770109087 >> v1:172.21.15.53:6789/0 conn(0x7f17cc0cc560 legacy=0x7f17cc0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 -- 172.21.15.53:0/1770109087 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc068ee0 con 0x7f17cc069ca0 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17caffd700 1 -- 172.21.15.53:0/1770109087 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369737983 0 0) 0x7f17cc0ccaa0 con 0x7f17cc0cc560 2023-09-28T00:24:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.096+0000 7f17d0f9c700 1 --2- 172.21.15.53:0/1770109087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc069ca0 0x7f17cc06a100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17cc071520 tx=0x7f17c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9207397d6884381c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17caffd700 1 -- 172.21.15.53:0/1770109087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400e070 con 0x7f17cc069ca0 2023-09-28T00:24:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17caffd700 1 -- 172.21.15.53:0/1770109087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17c400bbf0 con 0x7f17cc069ca0 2023-09-28T00:24:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17caffd700 1 -- 172.21.15.53:0/1770109087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4012430 con 0x7f17cc069ca0 2023-09-28T00:24:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 -- 172.21.15.53:0/1770109087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc069ca0 msgr2=0x7f17cc06a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 --2- 172.21.15.53:0/1770109087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc069ca0 0x7f17cc06a100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17cc071520 tx=0x7f17c4009780 comp rx=0 tx=0).stop 2023-09-28T00:24:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 -- 172.21.15.53:0/1770109087 shutdown_connections 2023-09-28T00:24:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 --2- 172.21.15.53:0/1770109087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc069ca0 0x7f17cc06a100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 --2- 172.21.15.53:0/1770109087 >> v2:172.21.15.118:3300/0 conn(0x7f17cc0add50 0x7f17cc1560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 -- 172.21.15.53:0/1770109087 >> 172.21.15.53:0/1770109087 conn(0x7f17cc06f7f0 msgr2=0x7f17cc0cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 -- 172.21.15.53:0/1770109087 shutdown_connections 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.097+0000 7f17d179d700 1 -- 172.21.15.53:0/1770109087 wait complete. 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.099+0000 7f17d179d700 1 Processor -- start 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.099+0000 7f17d179d700 1 -- start start 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d179d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17cc069ca0 0x7f17cc151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d179d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 0x7f17cc14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d179d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17cc0cc560 0x7f17cc158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d179d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc151690 con 0x7f17cc0add50 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d179d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0b1c40 con 0x7f17cc0cc560 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d179d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc152d00 con 0x7f17cc069ca0 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 0x7f17cc14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 0x7f17cc14f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54260/0 (socket says 172.21.15.53:54260) 2023-09-28T00:24:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17cb7fe700 1 -- 172.21.15.53:0/2152989108 learned_addr learned my addr 172.21.15.53:0/2152989108 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17cc069ca0 0x7f17cc151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.100+0000 7f17d0f9c700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17cc0cc560 0x7f17cc158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17cb7fe700 1 -- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17cc069ca0 msgr2=0x7f17cc151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17cb7fe700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17cc069ca0 0x7f17cc151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17cb7fe700 1 -- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17cc0cc560 msgr2=0x7f17cc158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17cb7fe700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17cc0cc560 0x7f17cc158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17cb7fe700 1 -- 172.21.15.53:0/2152989108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4009a20 con 0x7f17cc0add50 2023-09-28T00:24:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17cb7fe700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 0x7f17cc14f3a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17c000c7e0 tx=0x7f17c0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0005b30 con 0x7f17cc0add50 2023-09-28T00:24:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17c0005c90 con 0x7f17cc0add50 2023-09-28T00:24:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0007320 con 0x7f17cc0add50 2023-09-28T00:24:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc152060 con 0x7f17cc0add50 2023-09-28T00:24:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.101+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc169640 con 0x7f17cc0add50 2023-09-28T00:24:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.102+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc151840 con 0x7f17cc0add50 2023-09-28T00:24:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.103+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f17c001b3b0 con 0x7f17cc0add50 2023-09-28T00:24:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.104+0000 7f17b3fff700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f17b8067330 0x7f17b80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.104+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17c00840c0 con 0x7f17cc0add50 2023-09-28T00:24:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.105+0000 7f17cbfff700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f17b8067330 0x7f17b80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.105+0000 7f17cbfff700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f17b8067330 0x7f17b80697e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009db0 tx=0x7f17bc0091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.108+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f17cc151840 con 0x7f17cc0add50 2023-09-28T00:24:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.356+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17cc04c3c0 con 0x7f17cc0add50 2023-09-28T00:24:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.357+0000 7f17b3fff700 1 -- 172.21.15.53:0/2152989108 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6168 (secure 0 0 0) 0x7f17c0050fa0 con 0x7f17cc0add50 2023-09-28T00:24:55.357 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:24:55.358 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:22:59.682569+0000","modified":"2023-09-28T00:23:06.715808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4299,"mds_1":4296,"mds_2":4291,"mds_3":4271,"mds_4":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4271":{"gid":4271,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4291":{"gid":4291,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4296":{"gid":4296,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4299":{"gid":4299,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:24:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.359+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f17b8067330 msgr2=0x7f17b80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.359+0000 7f17d179d700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f17b8067330 0x7f17b80697e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009db0 tx=0x7f17bc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.359+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 msgr2=0x7f17cc14f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.359+0000 7f17d179d700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 0x7f17cc14f3a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17c000c7e0 tx=0x7f17c0007df0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 shutdown_connections 2023-09-28T00:24:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f17b8067330 0x7f17b80697e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17cc069ca0 0x7f17cc151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17cc0cc560 0x7f17cc158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 --2- 172.21.15.53:0/2152989108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0add50 0x7f17cc14f3a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 >> 172.21.15.53:0/2152989108 conn(0x7f17cc06f7f0 msgr2=0x7f17cc0cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 shutdown_connections 2023-09-28T00:24:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.360+0000 7f17d179d700 1 -- 172.21.15.53:0/2152989108 wait complete. 2023-09-28T00:24:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2023-09-28T00:24:55.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:24:55.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.565+0000 7faad6d9d700 1 Processor -- start 2023-09-28T00:24:55.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.565+0000 7faad6d9d700 1 -- start start 2023-09-28T00:24:55.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.566+0000 7faad6d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faad0068b60 0x7faad00ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.566+0000 7faad6d9d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faad0159610 0x7faad014f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.566+0000 7faad6d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad0159b20 con 0x7faad00add10 2023-09-28T00:24:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.566+0000 7faad6d9d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00c7350 con 0x7faad0159610 2023-09-28T00:24:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.566+0000 7faad6d9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad0155b50 con 0x7faad0068b60 2023-09-28T00:24:55.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad659c700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faad0159610 0x7faad014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad559a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faad0068b60 0x7faad00ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad5d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7faad00add10 0x7faad0155fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:49908/0 (socket says 172.21.15.53:49908) 2023-09-28T00:24:55.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad5d9b700 1 -- 172.21.15.53:0/112960126 learned_addr learned my addr 172.21.15.53:0/112960126 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:55.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad659c700 1 -- 172.21.15.53:0/112960126 >> v2:172.21.15.118:3300/0 conn(0x7faad0068b60 msgr2=0x7faad00ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:55.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad659c700 1 --2- 172.21.15.53:0/112960126 >> v2:172.21.15.118:3300/0 conn(0x7faad0068b60 0x7faad00ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad659c700 1 -- 172.21.15.53:0/112960126 >> v1:172.21.15.118:6789/0 conn(0x7faad00add10 legacy=0x7faad0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad659c700 1 -- 172.21.15.53:0/112960126 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00c6d90 con 0x7faad0159610 2023-09-28T00:24:55.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad559a700 1 --2- 172.21.15.53:0/112960126 >> v2:172.21.15.118:3300/0 conn(0x7faad0068b60 0x7faad00ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:55.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.567+0000 7faad659c700 1 --2- 172.21.15.53:0/112960126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014f440 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faad00893c0 tx=0x7faac8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94907c126143b8c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:55.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad4d99700 1 -- 172.21.15.53:0/112960126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800e070 con 0x7faad0159610 2023-09-28T00:24:55.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad4d99700 1 -- 172.21.15.53:0/112960126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faac800bb60 con 0x7faad0159610 2023-09-28T00:24:55.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad4d99700 1 -- 172.21.15.53:0/112960126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8012430 con 0x7faad0159610 2023-09-28T00:24:55.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 -- 172.21.15.53:0/112960126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 msgr2=0x7faad014f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 --2- 172.21.15.53:0/112960126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014f440 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faad00893c0 tx=0x7faac8009780 comp rx=0 tx=0).stop 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 -- 172.21.15.53:0/112960126 shutdown_connections 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 --2- 172.21.15.53:0/112960126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014f440 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 --2- 172.21.15.53:0/112960126 >> v2:172.21.15.118:3300/0 conn(0x7faad0068b60 0x7faad00ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 -- 172.21.15.53:0/112960126 >> 172.21.15.53:0/112960126 conn(0x7faad006f7f0 msgr2=0x7faad00cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 -- 172.21.15.53:0/112960126 shutdown_connections 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.568+0000 7faad6d9d700 1 -- 172.21.15.53:0/112960126 wait complete. 2023-09-28T00:24:55.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.570+0000 7faad6d9d700 1 Processor -- start 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.570+0000 7faad6d9d700 1 -- start start 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad6d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad0068b60 0x7faad00c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad6d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faad00add10 0x7faad0154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad6d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0153cd0 con 0x7faad0159610 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad6d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00c3060 con 0x7faad0068b60 2023-09-28T00:24:55.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad6d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad0168f60 con 0x7faad00add10 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad0068b60 0x7faad00c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad559a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faad00add10 0x7faad0154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad0068b60 0x7faad00c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:35902/0 (socket says 172.21.15.53:35902) 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad5d9b700 1 -- 172.21.15.53:0/1863564026 learned_addr learned my addr 172.21.15.53:0/1863564026 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad559a700 1 -- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad0068b60 msgr2=0x7faad00c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad559a700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad0068b60 0x7faad00c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad559a700 1 -- 172.21.15.53:0/1863564026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 msgr2=0x7faad014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad559a700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.571+0000 7faad559a700 1 -- 172.21.15.53:0/1863564026 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009420 con 0x7faad00add10 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.572+0000 7faad559a700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faad00add10 0x7faad0154260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faac000ea00 tx=0x7faac00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.572+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000c6a0 con 0x7faad00add10 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.572+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faac000c800 con 0x7faad00add10 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.572+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac8009a20 con 0x7faad00add10 2023-09-28T00:24:55.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.572+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000cbc0 con 0x7faad00add10 2023-09-28T00:24:55.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.572+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad00b1b80 con 0x7faad00add10 2023-09-28T00:24:55.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.573+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad004c3c0 con 0x7faad00add10 2023-09-28T00:24:55.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.574+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7faac0005a00 con 0x7faad00add10 2023-09-28T00:24:55.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.575+0000 7faac5ffb700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7faab4067330 0x7faab40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:55.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.575+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faac0085270 con 0x7faad00add10 2023-09-28T00:24:55.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.575+0000 7faad5d9b700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7faab4067330 0x7faab40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:55.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.576+0000 7faad5d9b700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7faab4067330 0x7faab40697e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faacc007130 tx=0x7faacc007f70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:55.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.579+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faac00521d0 con 0x7faad00add10 2023-09-28T00:24:55.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.827+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faad00ac480 con 0x7faad00add10 2023-09-28T00:24:55.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.828+0000 7faac5ffb700 1 -- 172.21.15.53:0/1863564026 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+6168 (secure 0 0 0) 0x7faac00557f0 con 0x7faad00add10 2023-09-28T00:24:55.828 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:24:55.828 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4268,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1227677714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":1227677714},{"type":"v1","addr":"172.21.15.118:6837","nonce":1227677714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:22:59.682569+0000","modified":"2023-09-28T00:23:06.715808+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4299,"mds_1":4296,"mds_2":4291,"mds_3":4271,"mds_4":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6836/444893830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":444893830},{"type":"v1","addr":"172.21.15.118:6836","nonce":444893830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4271":{"gid":4271,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6839/853666591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":853666591},{"type":"v1","addr":"172.21.15.118:6839","nonce":853666591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4291":{"gid":4291,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6837/3451016827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":3451016827},{"type":"v1","addr":"172.21.15.53:6837","nonce":3451016827}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4296":{"gid":4296,"name":"a","rank":1,"incarnation":9,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6833/2321695931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2321695931},{"type":"v1","addr":"172.21.15.53:6833","nonce":2321695931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4299":{"gid":4299,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/4226289239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":4226289239},{"type":"v1","addr":"172.21.15.53:6836","nonce":4226289239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:24:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.830+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7faab4067330 msgr2=0x7faab40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.830+0000 7faad6d9d700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7faab4067330 0x7faab40697e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faacc007130 tx=0x7faacc007f70 comp rx=0 tx=0).stop 2023-09-28T00:24:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.830+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faad00add10 msgr2=0x7faad0154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.830+0000 7faad6d9d700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faad00add10 0x7faad0154260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faac000ea00 tx=0x7faac00091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 shutdown_connections 2023-09-28T00:24:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7faab4067330 0x7faab40697e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faad0159610 0x7faad014e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad0068b60 0x7faad00c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 --2- 172.21.15.53:0/1863564026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faad00add10 0x7faad0154260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 >> 172.21.15.53:0/1863564026 conn(0x7faad006f7f0 msgr2=0x7faad00c86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 shutdown_connections 2023-09-28T00:24:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:55.831+0000 7faad6d9d700 1 -- 172.21.15.53:0/1863564026 wait complete. 2023-09-28T00:24:55.833 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2023-09-28T00:24:55.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:24:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.036+0000 7f7a0b59d700 1 Processor -- start 2023-09-28T00:24:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.036+0000 7f7a0b59d700 1 -- start start 2023-09-28T00:24:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.037+0000 7f7a0b59d700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7a040add10 0x7f7a04155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.037+0000 7f7a0b59d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a04159b20 con 0x7f7a04068b60 2023-09-28T00:24:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0b59d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a040c7350 con 0x7f7a04159610 2023-09-28T00:24:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0b59d700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a04155b50 con 0x7f7a040add10 2023-09-28T00:24:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0a59b700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7a040add10 0x7f7a04155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a09d9a700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7a04068b60 0x7f7a040ae0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44662/0 (socket says 172.21.15.53:44662) 2023-09-28T00:24:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a09d9a700 1 -- 172.21.15.53:0/3970269917 learned_addr learned my addr 172.21.15.53:0/3970269917 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:56.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0a59b700 1 -- 172.21.15.53:0/3970269917 >> v1:172.21.15.118:6789/0 conn(0x7f7a04159610 legacy=0x7f7a0414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0a59b700 1 -- 172.21.15.53:0/3970269917 >> v1:172.21.15.53:6789/0 conn(0x7f7a04068b60 legacy=0x7f7a040ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0a59b700 1 -- 172.21.15.53:0/3970269917 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040ae7f0 con 0x7f7a040add10 2023-09-28T00:24:56.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.038+0000 7f7a0a59b700 1 --2- 172.21.15.53:0/3970269917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a040add10 0x7f7a04155fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098e0 tx=0x7f7a000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d371c36a59bf68 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a09599700 1 -- 172.21.15.53:0/3970269917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00009e80 con 0x7f7a040add10 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a09599700 1 -- 172.21.15.53:0/3970269917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7a0000b860 con 0x7f7a040add10 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a09599700 1 -- 172.21.15.53:0/3970269917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000bc00 con 0x7f7a040add10 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3970269917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a040add10 msgr2=0x7f7a04155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3970269917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a040add10 0x7f7a04155fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098e0 tx=0x7f7a000091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3970269917 shutdown_connections 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3970269917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a040add10 0x7f7a04155fe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3970269917 >> 172.21.15.53:0/3970269917 conn(0x7f7a0406f7f0 msgr2=0x7f7a040cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:56.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.039+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3970269917 shutdown_connections 2023-09-28T00:24:56.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.040+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3970269917 wait complete. 2023-09-28T00:24:56.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.041+0000 7f7a0b59d700 1 Processor -- start 2023-09-28T00:24:56.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.041+0000 7f7a0b59d700 1 -- start start 2023-09-28T00:24:56.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0b59d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a04068b60 0x7f7a04165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0b59d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a040add10 0x7f7a04069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0b59d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 0x7f7a040b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0b59d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04152540 con 0x7f7a04159610 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0b59d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040b0740 con 0x7f7a040add10 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0b59d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04152fa0 con 0x7f7a04068b60 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0a59b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a04068b60 0x7f7a04165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 0x7f7a040b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a09d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a040add10 0x7f7a04069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 0x7f7a040b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34386/0 (socket says 172.21.15.53:34386) 2023-09-28T00:24:56.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 -- 172.21.15.53:0/3894701136 learned_addr learned my addr 172.21.15.53:0/3894701136 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:56.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0a59b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a04068b60 0x7f7a04165af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:56782/0 (socket says 172.21.15.53:56782) 2023-09-28T00:24:56.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 -- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a04068b60 msgr2=0x7f7a04165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a04068b60 0x7f7a04165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 -- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a040add10 msgr2=0x7f7a04069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.042+0000 7f7a0ad9c700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a040add10 0x7f7a04069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f7a0ad9c700 1 -- 172.21.15.53:0/3894701136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00009420 con 0x7f7a04159610 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f7a0ad9c700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 0x7f7a040b0eb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00c940 tx=0x7f79fc0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc012630 con 0x7f7a04159610 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f79fc012790 con 0x7f7a04159610 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc012b70 con 0x7f7a04159610 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0406a6a0 con 0x7f7a04159610 2023-09-28T00:24:56.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.043+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a040af420 con 0x7f7a04159610 2023-09-28T00:24:56.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.044+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0404c3c0 con 0x7f7a04159610 2023-09-28T00:24:56.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.045+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f79fc01b450 con 0x7f7a04159610 2023-09-28T00:24:56.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.046+0000 7f79fa7fc700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f79e8067330 0x7f79e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.046+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f79fc084d70 con 0x7f7a04159610 2023-09-28T00:24:56.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.047+0000 7f7a0a59b700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f79e8067330 0x7f79e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.047+0000 7f7a0a59b700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f79e8067330 0x7f79e80697e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a000093f0 tx=0x7f7a000091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:56.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.051+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f79fc0556e0 con 0x7f7a04159610 2023-09-28T00:24:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.255+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a040c6d90 con 0x7f7a04159610 2023-09-28T00:24:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.256+0000 7f79fa7fc700 1 -- 172.21.15.53:0/3894701136 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f79fc055270 con 0x7f7a04159610 2023-09-28T00:24:56.257 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-28T00:24:56.257 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"95448d9d-c293-4b2c-9850-98d8a7632343","created":"2023-09-28T00:22:33.464364+0000","modified":"2023-09-28T00:23:00.684587+0000","last_up_change":"2023-09-28T00:22:44.803434+0000","last_in_change":"2023-09-28T00:22:35.992136+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:22:45.151575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:22:52.312450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:22:58.139047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:22:58.662077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4dabe882-062f-45b6-90f4-0fa4237378af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":85093},{"type":"v1","addr":"172.21.15.53:6801","nonce":85093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":85093},{"type":"v1","addr":"172.21.15.53:6805","nonce":85093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":85093},{"type":"v1","addr":"172.21.15.53:6813","nonce":85093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":85093},{"type":"v1","addr":"172.21.15.53:6809","nonce":85093}]},"public_addr":"172.21.15.53:6801/85093","cluster_addr":"172.21.15.53:6805/85093","heartbeat_back_addr":"172.21.15.53:6813/85093","heartbeat_front_addr":"172.21.15.53:6809/85093","state":["exists","up"]},{"osd":1,"uuid":"ac81b9ba-2f2b-4ac7-89b3-15f5959294e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":85092},{"type":"v1","addr":"172.21.15.53:6804","nonce":85092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":85092},{"type":"v1","addr":"172.21.15.53:6808","nonce":85092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":85092},{"type":"v1","addr":"172.21.15.53:6815","nonce":85092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":85092},{"type":"v1","addr":"172.21.15.53:6812","nonce":85092}]},"public_addr":"172.21.15.53:6804/85092","cluster_addr":"172.21.15.53:6808/85092","heartbeat_back_addr":"172.21.15.53:6815/85092","heartbeat_front_addr":"172.21.15.53:6812/85092","state":["exists","up"]},{"osd":2,"uuid":"5628779f-7bc6-4ba2-b491-6c55e8d67390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":85121},{"type":"v1","addr":"172.21.15.53:6825","nonce":85121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":85121},{"type":"v1","addr":"172.21.15.53:6827","nonce":85121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":85121},{"type":"v1","addr":"172.21.15.53:6831","nonce":85121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":85121},{"type":"v1","addr":"172.21.15.53:6829","nonce":85121}]},"public_addr":"172.21.15.53:6825/85121","cluster_addr":"172.21.15.53:6827/85121","heartbeat_back_addr":"172.21.15.53:6831/85121","heartbeat_front_addr":"172.21.15.53:6829/85121","state":["exists","up"]},{"osd":3,"uuid":"0f92e347-502d-4708-8e30-df844fed4ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":85094},{"type":"v1","addr":"172.21.15.53:6817","nonce":85094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":85094},{"type":"v1","addr":"172.21.15.53:6819","nonce":85094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":85094},{"type":"v1","addr":"172.21.15.53:6823","nonce":85094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":85094},{"type":"v1","addr":"172.21.15.53:6821","nonce":85094}]},"public_addr":"172.21.15.53:6817/85094","cluster_addr":"172.21.15.53:6819/85094","heartbeat_back_addr":"172.21.15.53:6823/85094","heartbeat_front_addr":"172.21.15.53:6821/85094","state":["exists","up"]},{"osd":4,"uuid":"aabca63d-493c-4018-8c57-91a281625f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":120721},{"type":"v1","addr":"172.21.15.118:6801","nonce":120721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":120721},{"type":"v1","addr":"172.21.15.118:6803","nonce":120721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":120721},{"type":"v1","addr":"172.21.15.118:6807","nonce":120721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":120721},{"type":"v1","addr":"172.21.15.118:6805","nonce":120721}]},"public_addr":"172.21.15.118:6801/120721","cluster_addr":"172.21.15.118:6803/120721","heartbeat_back_addr":"172.21.15.118:6807/120721","heartbeat_front_addr":"172.21.15.118:6805/120721","state":["exists","up"]},{"osd":5,"uuid":"19a05f38-04e6-4cf2-a931-2deb179a4165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":120751},{"type":"v1","addr":"172.21.15.118:6825","nonce":120751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":120751},{"type":"v1","addr":"172.21.15.118:6827","nonce":120751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":120751},{"type":"v1","addr":"172.21.15.118:6831","nonce":120751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":120751},{"type":"v1","addr":"172.21.15.118:6829","nonce":120751}]},"public_addr":"172.21.15.118:6825/120751","cluster_addr":"172.21.15.118:6827/120751","heartbeat_back_addr":"172.21.15.118:6831/120751","heartbeat_front_addr":"172.21.15.118:6829/120751","state":["exists","up"]},{"osd":6,"uuid":"fc48de62-15c9-469e-8485-8db16d31f052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":120722},{"type":"v1","addr":"172.21.15.118:6809","nonce":120722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":120722},{"type":"v1","addr":"172.21.15.118:6811","nonce":120722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":120722},{"type":"v1","addr":"172.21.15.118:6815","nonce":120722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":120722},{"type":"v1","addr":"172.21.15.118:6813","nonce":120722}]},"public_addr":"172.21.15.118:6809/120722","cluster_addr":"172.21.15.118:6811/120722","heartbeat_back_addr":"172.21.15.118:6815/120722","heartbeat_front_addr":"172.21.15.118:6813/120722","state":["exists","up"]},{"osd":7,"uuid":"fc853be2-5788-4be1-a4b6-57b7113dc5fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":120752},{"type":"v1","addr":"172.21.15.118:6817","nonce":120752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":120752},{"type":"v1","addr":"172.21.15.118:6819","nonce":120752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":120752},{"type":"v1","addr":"172.21.15.118:6823","nonce":120752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":120752},{"type":"v1","addr":"172.21.15.118:6821","nonce":120752}]},"public_addr":"172.21.15.118:6817/120752","cluster_addr":"172.21.15.118:6819/120752","heartbeat_back_addr":"172.21.15.118:6823/120752","heartbeat_front_addr":"172.21.15.118:6821/120752","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.303198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.571051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.588947+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.278403+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:40.926946+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.188922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.150216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:22:41.224185+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:24:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f79e8067330 msgr2=0x7f79e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f79e8067330 0x7f79e80697e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a000093f0 tx=0x7f7a000091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 msgr2=0x7f7a040b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 0x7f7a040b0eb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00c940 tx=0x7f79fc0016f0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 shutdown_connections 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f79e8067330 0x7f79e80697e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a04068b60 0x7f7a04165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a04159610 0x7f7a040b0eb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 --2- 172.21.15.53:0/3894701136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a040add10 0x7f7a04069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 >> 172.21.15.53:0/3894701136 conn(0x7f7a0406f7f0 msgr2=0x7f7a04153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 shutdown_connections 2023-09-28T00:24:56.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.259+0000 7f7a0b59d700 1 -- 172.21.15.53:0/3894701136 wait complete. 2023-09-28T00:24:56.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-28T00:24:56.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.464+0000 7f9676d9d700 1 Processor -- start 2023-09-28T00:24:56.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.464+0000 7f9676d9d700 1 -- start start 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9676d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9676d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96700c4fe0 0x7f9670152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9676d9d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9670156a00 con 0x7f96700c0d60 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9676d9d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9670156560 con 0x7f96700c4fe0 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9676d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700bf260 con 0x7f96700c0990 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9675d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f967559a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96700c4fe0 0x7f9670152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f967659c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f96700c0d60 0x7f967006da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.53:42468/0 (socket says 172.21.15.53:42468) 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f967659c700 1 -- 172.21.15.53:0/2864092037 learned_addr learned my addr 172.21.15.53:0/2864092037 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9675d9b700 1 -- 172.21.15.53:0/2864092037 >> v2:172.21.15.118:3300/0 conn(0x7f96700c4fe0 msgr2=0x7f9670152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9675d9b700 1 --2- 172.21.15.53:0/2864092037 >> v2:172.21.15.118:3300/0 conn(0x7f96700c4fe0 0x7f9670152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9675d9b700 1 -- 172.21.15.53:0/2864092037 >> v1:172.21.15.118:6789/0 conn(0x7f96700c0d60 legacy=0x7f967006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.466+0000 7f9675d9b700 1 -- 172.21.15.53:0/2864092037 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670152a10 con 0x7f96700c0990 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.467+0000 7f9675d9b700 1 --2- 172.21.15.53:0/2864092037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700bed20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f966c0098e0 tx=0x7f966c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651f05c29aebe1b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.467+0000 7f9674d99700 1 -- 172.21.15.53:0/2864092037 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00b640 con 0x7f96700c0990 2023-09-28T00:24:56.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.467+0000 7f9674d99700 1 -- 172.21.15.53:0/2864092037 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f966c00b7a0 con 0x7f96700c0990 2023-09-28T00:24:56.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.467+0000 7f9674d99700 1 -- 172.21.15.53:0/2864092037 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00bb60 con 0x7f96700c0990 2023-09-28T00:24:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.467+0000 7f9676d9d700 1 -- 172.21.15.53:0/2864092037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 msgr2=0x7f96700bed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.467+0000 7f9676d9d700 1 --2- 172.21.15.53:0/2864092037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700bed20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f966c0098e0 tx=0x7f966c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.468+0000 7f9676d9d700 1 -- 172.21.15.53:0/2864092037 shutdown_connections 2023-09-28T00:24:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.468+0000 7f9676d9d700 1 --2- 172.21.15.53:0/2864092037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700bed20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.468+0000 7f9676d9d700 1 --2- 172.21.15.53:0/2864092037 >> v2:172.21.15.118:3300/0 conn(0x7f96700c4fe0 0x7f9670152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.468+0000 7f9676d9d700 1 -- 172.21.15.53:0/2864092037 >> 172.21.15.53:0/2864092037 conn(0x7f9670067630 msgr2=0x7f9670067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.468+0000 7f9676d9d700 1 -- 172.21.15.53:0/2864092037 shutdown_connections 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.468+0000 7f9676d9d700 1 -- 172.21.15.53:0/2864092037 wait complete. 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.469+0000 7f9676d9d700 1 Processor -- start 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.469+0000 7f9676d9d700 1 -- start start 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9676d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9676d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96700c0d60 0x7f96701690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9676d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96700c4fe0 0x7f9670143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9676d9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9670145340 con 0x7f96700c4fe0 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9676d9d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c78c0 con 0x7f96700c0d60 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9676d9d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c6ef0 con 0x7f96700c0990 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f967659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96700c4fe0 0x7f9670143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9675d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f967559a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96700c0d60 0x7f96701690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9675d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:56792/0 (socket says 172.21.15.53:56792) 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.470+0000 7f9675d9b700 1 -- 172.21.15.53:0/170798391 learned_addr learned my addr 172.21.15.53:0/170798391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9675d9b700 1 -- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96700c0d60 msgr2=0x7f96701690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9675d9b700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96700c0d60 0x7f96701690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9675d9b700 1 -- 172.21.15.53:0/170798391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96700c4fe0 msgr2=0x7f9670143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9675d9b700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96700c4fe0 0x7f9670143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9675d9b700 1 -- 172.21.15.53:0/170798391 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c009420 con 0x7f96700c0990 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f967559a700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96700c0d60 0x7f96701690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9675d9b700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700c7380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f966c0093f0 tx=0x7f966c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c01b9e0 con 0x7f96700c0990 2023-09-28T00:24:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f966c01bb60 con 0x7f96700c0990 2023-09-28T00:24:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700c6910 con 0x7f96700c0990 2023-09-28T00:24:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.471+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c025420 con 0x7f96700c0990 2023-09-28T00:24:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.472+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96700c64b0 con 0x7f96700c0990 2023-09-28T00:24:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.472+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967004c3c0 con 0x7f96700c0990 2023-09-28T00:24:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.474+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f966c023070 con 0x7f96700c0990 2023-09-28T00:24:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.474+0000 7f9665ffb700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9654067330 0x7f96540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.474+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f966c047e40 con 0x7f96700c0990 2023-09-28T00:24:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.475+0000 7f967559a700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9654067330 0x7f96540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.475+0000 7f967559a700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9654067330 0x7f96540697e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f967014bca0 tx=0x7f96600091a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.478+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f966c0532a0 con 0x7f96700c0990 2023-09-28T00:24:56.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:56.727+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f96700c71d0 con 0x7f96700c0990 2023-09-28T00:24:57.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.550+0000 7f9665ffb700 1 -- 172.21.15.53:0/170798391 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f966c056880 con 0x7f96700c0990 2023-09-28T00:24:57.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9654067330 msgr2=0x7f96540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9654067330 0x7f96540697e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f967014bca0 tx=0x7f96600091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 msgr2=0x7f96700c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700c7380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f966c0093f0 tx=0x7f966c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 shutdown_connections 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7f9654067330 0x7f96540697e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96700c0990 0x7f96700c7380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96700c4fe0 0x7f9670143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 --2- 172.21.15.53:0/170798391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96700c0d60 0x7f96701690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.553+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 >> 172.21.15.53:0/170798391 conn(0x7f9670067630 msgr2=0x7f967014a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:57.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.554+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 shutdown_connections 2023-09-28T00:24:57.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.554+0000 7f9676d9d700 1 -- 172.21.15.53:0/170798391 wait complete. 2023-09-28T00:24:57.555 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-28T00:24:57.568 INFO:tasks.ceph.mds.c.smithi053.stderr: -4124> 2023-09-28T00:23:05.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-28T00:24:57.568 INFO:tasks.ceph.mds.c.smithi053.stderr: -4122> 2023-09-28T00:23:05.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-09-28T00:24:57.568 INFO:tasks.ceph.mds.c.smithi053.stderr: -4120> 2023-09-28T00:23:05.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-09-28T00:24:57.569 INFO:tasks.ceph.mds.c.smithi053.stderr: -3826> 2023-09-28T00:23:10.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-09-28T00:24:57.569 INFO:tasks.ceph.mds.c.smithi053.stderr: -3824> 2023-09-28T00:23:10.305+0000 7fae0c1f1700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-09-28T00:24:57.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-28T00:24:57.577 INFO:tasks.ceph.mds.f.smithi118.stdout:starting mds.f at 2023-09-28T00:24:57.578 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-09-28T00:24:57.578 INFO:tasks.ceph.mds.f.smithi118.stderr:2023-09-28T00:24:57.578+0000 7f8dbb1c9700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-09-28T00:24:57.605 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-09-28T00:24:57.618 INFO:tasks.ceph.mds.e.smithi053.stdout:starting mds.e at 2023-09-28T00:24:57.623 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-09-28T00:24:57.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.778+0000 7fdea7fff700 1 Processor -- start 2023-09-28T00:24:57.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.778+0000 7fdea7fff700 1 -- start start 2023-09-28T00:24:57.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.779+0000 7fdea7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdea814d440 0x7fdea8157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:57.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.779+0000 7fdea7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdea80c0f50 0x7fdea80c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.779+0000 7fdea7fff700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80c3b70 con 0x7fdea814d070 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.779+0000 7fdea7fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea806b8f0 con 0x7fdea814d440 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.779+0000 7fdea7fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea806c3c0 con 0x7fdea80c0f50 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdea814d440 0x7fdea8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdea814d440 0x7fdea8157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34444/0 (socket says 172.21.15.53:34444) 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 -- 172.21.15.53:0/3908387208 learned_addr learned my addr 172.21.15.53:0/3908387208 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea77fe700 1 --2- 172.21.15.53:0/3908387208 >> v2:172.21.15.118:3300/0 conn(0x7fdea80c0f50 0x7fdea80c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 -- 172.21.15.53:0/3908387208 >> v2:172.21.15.118:3300/0 conn(0x7fdea80c0f50 msgr2=0x7fdea80c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 --2- 172.21.15.53:0/3908387208 >> v2:172.21.15.118:3300/0 conn(0x7fdea80c0f50 0x7fdea80c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 -- 172.21.15.53:0/3908387208 >> v1:172.21.15.53:6789/0 conn(0x7fdea814d070 legacy=0x7fdea8153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 -- 172.21.15.53:0/3908387208 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8153930 con 0x7fdea814d440 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.780+0000 7fdea67fc700 1 --2- 172.21.15.53:0/3908387208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea8157230 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdea8150de0 tx=0x7fde9c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdcbdd76af5f231 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea5ffb700 1 -- 172.21.15.53:0/3908387208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c005c10 con 0x7fdea814d440 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea5ffb700 1 -- 172.21.15.53:0/3908387208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde9c005d70 con 0x7fdea814d440 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea5ffb700 1 -- 172.21.15.53:0/3908387208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c006280 con 0x7fdea814d440 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 -- 172.21.15.53:0/3908387208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 msgr2=0x7fdea8157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 --2- 172.21.15.53:0/3908387208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea8157230 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdea8150de0 tx=0x7fde9c009220 comp rx=0 tx=0).stop 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 -- 172.21.15.53:0/3908387208 shutdown_connections 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 --2- 172.21.15.53:0/3908387208 >> v2:172.21.15.118:3300/0 conn(0x7fdea80c0f50 0x7fdea80c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 --2- 172.21.15.53:0/3908387208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea8157230 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 -- 172.21.15.53:0/3908387208 >> 172.21.15.53:0/3908387208 conn(0x7fdea8069a30 msgr2=0x7fdea8069e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 -- 172.21.15.53:0/3908387208 shutdown_connections 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.781+0000 7fdea7fff700 1 -- 172.21.15.53:0/3908387208 wait complete. 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.783+0000 7fdea7fff700 1 Processor -- start 2023-09-28T00:24:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.783+0000 7fdea7fff700 1 -- start start 2023-09-28T00:24:57.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 0x7fdea81685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:57.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdea814d070 0x7fdea8163560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea7fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8167540 con 0x7fdea814d440 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea7fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81677e0 con 0x7fdea80c0f50 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea7fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8167ac0 con 0x7fdea814d070 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 0x7fdea81685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea67fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdea814d070 0x7fdea8163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 0x7fdea81685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:56524/0 (socket says 172.21.15.53:56524) 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 -- 172.21.15.53:0/1162572617 learned_addr learned my addr 172.21.15.53:0/1162572617 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea67fc700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdea814d070 0x7fdea8163560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:56848/0 (socket says 172.21.15.53:56848) 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 -- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdea814d070 msgr2=0x7fdea8163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdea814d070 0x7fdea8163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 -- 172.21.15.53:0/1162572617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 msgr2=0x7fdea814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea814ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:57.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.784+0000 7fdea6ffd700 1 -- 172.21.15.53:0/1162572617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009480 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.785+0000 7fdea6ffd700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 0x7fdea81685a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fde9800c590 tx=0x7fde9800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.785+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011590 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.785+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde98011710 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.785+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8167da0 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.785+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011af0 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.785+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea81574f0 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.786+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea81682c0 con 0x7fdea80c0f50 2023-09-28T00:24:57.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.787+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fde9801b3b0 con 0x7fdea80c0f50 2023-09-28T00:24:57.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.788+0000 7fde8effd700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fde94067330 0x7fde940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:57.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.788+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6488+0+0 (secure 0 0 0) 0x7fde98084290 con 0x7fdea80c0f50 2023-09-28T00:24:57.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.788+0000 7fdea67fc700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fde94067330 0x7fde940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:57.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.788+0000 7fdea67fc700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fde94067330 0x7fde940697e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdea814d8a0 tx=0x7fde9c009220 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:57.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:57.792+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdea81682c0 con 0x7fdea80c0f50 2023-09-28T00:24:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.038+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdea81682c0 con 0x7fdea80c0f50 2023-09-28T00:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.554+0000 7fde8effd700 1 -- 172.21.15.53:0/1162572617 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdea81682c0 con 0x7fdea80c0f50 2023-09-28T00:24:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fde94067330 msgr2=0x7fde940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fde94067330 0x7fde940697e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdea814d8a0 tx=0x7fde9c009220 comp rx=0 tx=0).stop 2023-09-28T00:24:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 msgr2=0x7fdea81685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 0x7fdea81685a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fde9800c590 tx=0x7fde9800c8a0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 shutdown_connections 2023-09-28T00:24:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fde94067330 0x7fde940697e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea814d440 0x7fdea814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdea80c0f50 0x7fdea81685a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 --2- 172.21.15.53:0/1162572617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdea814d070 0x7fdea8163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 >> 172.21.15.53:0/1162572617 conn(0x7fdea8069a30 msgr2=0x7fdea814b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 shutdown_connections 2023-09-28T00:24:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.557+0000 7fdea7fff700 1 -- 172.21.15.53:0/1162572617 wait complete. 2023-09-28T00:24:58.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-28T00:24:58.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.809+0000 7fa0c699d700 1 Processor -- start 2023-09-28T00:24:58.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.809+0000 7fa0c699d700 1 -- start start 2023-09-28T00:24:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.810+0000 7fa0c699d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00adce0 0x7fa0c00ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.810+0000 7fa0c699d700 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0157ba0 con 0x7fa0c00abb30 2023-09-28T00:24:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.810+0000 7fa0c699d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0156450 con 0x7fa0c00ad910 2023-09-28T00:24:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.810+0000 7fa0c699d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c01534e0 con 0x7fa0c00adce0 2023-09-28T00:24:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c619c700 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa0c00abb30 0x7fa0c014ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44704/0 (socket says 172.21.15.53:44704) 2023-09-28T00:24:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c619c700 1 -- 172.21.15.53:0/1247189843 learned_addr learned my addr 172.21.15.53:0/1247189843 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-09-28T00:24:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c519a700 1 --2- 172.21.15.53:0/1247189843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00adce0 0x7fa0c00ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095771803 0 0) 0x7fa0c0157ba0 con 0x7fa0c00abb30 2023-09-28T00:24:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ac003570 con 0x7fa0c00abb30 2023-09-28T00:24:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842311773 0 0) 0x7fa0c0156450 con 0x7fa0c00ad910 2023-09-28T00:24:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c0157ba0 con 0x7fa0c00ad910 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c519a700 1 -- 172.21.15.53:0/1247189843 >> v1:172.21.15.118:6789/0 conn(0x7fa0c00ad910 legacy=0x7fa0c0158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c519a700 1 -- 172.21.15.53:0/1247189843 >> v1:172.21.15.53:6789/0 conn(0x7fa0c00abb30 legacy=0x7fa0c014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.811+0000 7fa0c519a700 1 -- 172.21.15.53:0/1247189843 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c01569f0 con 0x7fa0c00adce0 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c519a700 1 --2- 172.21.15.53:0/1247189843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00adce0 0x7fa0c00ab5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0156be0 tx=0x7fa0b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ac8a04fc817bbc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0011630 con 0x7fa0c00adce0 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa0b0011790 con 0x7fa0c00adce0 2023-09-28T00:24:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c4999700 1 -- 172.21.15.53:0/1247189843 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0011b70 con 0x7fa0c00adce0 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 -- 172.21.15.53:0/1247189843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00adce0 msgr2=0x7fa0c00ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1247189843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00adce0 0x7fa0c00ab5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0156be0 tx=0x7fa0b00091a0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 -- 172.21.15.53:0/1247189843 shutdown_connections 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1247189843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00adce0 0x7fa0c00ab5f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 -- 172.21.15.53:0/1247189843 >> 172.21.15.53:0/1247189843 conn(0x7fa0c00cbdc0 msgr2=0x7fa0c00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 -- 172.21.15.53:0/1247189843 shutdown_connections 2023-09-28T00:24:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.812+0000 7fa0c699d700 1 -- 172.21.15.53:0/1247189843 wait complete. 2023-09-28T00:24:58.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.814+0000 7fa0c699d700 1 Processor -- start 2023-09-28T00:24:58.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.814+0000 7fa0c699d700 1 -- start start 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c699d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0c00abb30 0x7fa0c00c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c699d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00ad910 0x7fa0c00c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c699d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 0x7fa0c014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c699d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00b1c30 con 0x7fa0c00adce0 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c699d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00c6b60 con 0x7fa0c00abb30 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c699d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0156230 con 0x7fa0c00ad910 2023-09-28T00:24:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c619c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 0x7fa0c014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c619c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 0x7fa0c014cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34474/0 (socket says 172.21.15.53:34474) 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c619c700 1 -- 172.21.15.53:0/1389802588 learned_addr learned my addr 172.21.15.53:0/1389802588 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c599b700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0c00abb30 0x7fa0c00c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.815+0000 7fa0c519a700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00ad910 0x7fa0c00c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c619c700 1 -- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00ad910 msgr2=0x7fa0c00c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c619c700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00ad910 0x7fa0c00c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c619c700 1 -- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0c00abb30 msgr2=0x7fa0c00c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c619c700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0c00abb30 0x7fa0c00c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c619c700 1 -- 172.21.15.53:0/1389802588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0009420 con 0x7fa0c00adce0 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c599b700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0c00abb30 0x7fa0c00c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c619c700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 0x7fa0c014cf00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800cbc0 tx=0x7fa0b8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800a870 con 0x7fa0c00adce0 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa0b800a9d0 con 0x7fa0c00adce0 2023-09-28T00:24:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800adb0 con 0x7fa0c00adce0 2023-09-28T00:24:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c00c5860 con 0x7fa0c00adce0 2023-09-28T00:24:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.816+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c01661f0 con 0x7fa0c00adce0 2023-09-28T00:24:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.817+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c0071830 con 0x7fa0c00adce0 2023-09-28T00:24:58.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.818+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa0b8007300 con 0x7fa0c00adce0 2023-09-28T00:24:58.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.819+0000 7fa0b5ffb700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa0a4067360 0x7fa0a4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:58.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.819+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6488+0+0 (secure 0 0 0) 0x7fa0b80850e0 con 0x7fa0c00adce0 2023-09-28T00:24:58.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.819+0000 7fa0c599b700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa0a4067360 0x7fa0a4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:58.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.820+0000 7fa0c599b700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa0a4067360 0x7fa0a4069810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc007fd0 tx=0x7fa0bc007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:58.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:58.824+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa0b8051e90 con 0x7fa0c00adce0 2023-09-28T00:24:59.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.028+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa0c0156cb0 con 0x7fa0c00adce0 2023-09-28T00:24:59.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:24:59.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:24:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.561+0000 7fa0b5ffb700 1 -- 172.21.15.53:0/1389802588 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa0b80554b0 con 0x7fa0c00adce0 2023-09-28T00:24:59.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.564+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa0a4067360 msgr2=0x7fa0a4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:59.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.564+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa0a4067360 0x7fa0a4069810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc007fd0 tx=0x7fa0bc007d50 comp rx=0 tx=0).stop 2023-09-28T00:24:59.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.564+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 msgr2=0x7fa0c014cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:59.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.564+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 0x7fa0c014cf00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800cbc0 tx=0x7fa0b8001a20 comp rx=0 tx=0).stop 2023-09-28T00:24:59.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 shutdown_connections 2023-09-28T00:24:59.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fa0a4067360 0x7fa0a4069810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c00adce0 0x7fa0c014cf00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0c00abb30 0x7fa0c00c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 --2- 172.21.15.53:0/1389802588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0c00ad910 0x7fa0c00c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 >> 172.21.15.53:0/1389802588 conn(0x7fa0c00cbdc0 msgr2=0x7fa0c01536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:59.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 shutdown_connections 2023-09-28T00:24:59.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.565+0000 7fa0c699d700 1 -- 172.21.15.53:0/1389802588 wait complete. 2023-09-28T00:24:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-09-28T00:24:59.583 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-28T00:24:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.825+0000 7fb7e7fff700 1 Processor -- start 2023-09-28T00:24:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.825+0000 7fb7e7fff700 1 -- start start 2023-09-28T00:24:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 0x7fb7e806c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e7fff700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb7e80c4750 0x7fb7e80c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 0x7fb7e8156140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e7fff700 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e806cd10 con 0x7fb7e80c4750 2023-09-28T00:24:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e7fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e8069480 con 0x7fb7e80c69a0 2023-09-28T00:24:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e7fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e806a580 con 0x7fb7e80c56c0 2023-09-28T00:24:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e77fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 0x7fb7e8156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 0x7fb7e806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.826+0000 7fb7e67fc700 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb7e80c4750 0x7fb7e80c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 0x7fb7e8156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.53:56868/0 (socket says 172.21.15.53:56868) 2023-09-28T00:24:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 -- 172.21.15.53:0/2233259618 learned_addr learned my addr 172.21.15.53:0/2233259618 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 0x7fb7e806c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.53:56532/0 (socket says 172.21.15.53:56532) 2023-09-28T00:24:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 -- 172.21.15.53:0/2233259618 >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 msgr2=0x7fb7e806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 --2- 172.21.15.53:0/2233259618 >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 0x7fb7e806c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 -- 172.21.15.53:0/2233259618 >> v2:172.21.15.53:3300/0 conn(0x7fb7e80c4750 msgr2=0x7fb7e80c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:24:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 --2- 172.21.15.53:0/2233259618 >> v2:172.21.15.53:3300/0 conn(0x7fb7e80c4750 0x7fb7e80c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 -- 172.21.15.53:0/2233259618 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8068870 con 0x7fb7e80c56c0 2023-09-28T00:24:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e6ffd700 1 --2- 172.21.15.53:0/2233259618 >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 0x7fb7e806c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e67fc700 1 --2- 172.21.15.53:0/2233259618 >> v2:172.21.15.53:3300/0 conn(0x7fb7e80c4750 0x7fb7e80c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:24:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e77fe700 1 --2- 172.21.15.53:0/2233259618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 0x7fb7e8156140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7e806f3f0 tx=0x7fb7e0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2462f68d28fe7f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.827+0000 7fb7e5ffb700 1 -- 172.21.15.53:0/2233259618 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000e070 con 0x7fb7e80c56c0 2023-09-28T00:24:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e5ffb700 1 -- 172.21.15.53:0/2233259618 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb7e000b970 con 0x7fb7e80c56c0 2023-09-28T00:24:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e5ffb700 1 -- 172.21.15.53:0/2233259618 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00092e0 con 0x7fb7e80c56c0 2023-09-28T00:24:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 -- 172.21.15.53:0/2233259618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 msgr2=0x7fb7e8156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/2233259618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 0x7fb7e8156140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7e806f3f0 tx=0x7fb7e0009840 comp rx=0 tx=0).stop 2023-09-28T00:24:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 -- 172.21.15.53:0/2233259618 shutdown_connections 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/2233259618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c56c0 0x7fb7e8156140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/2233259618 >> v2:172.21.15.118:3300/0 conn(0x7fb7e80c69a0 0x7fb7e806c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/2233259618 >> v2:172.21.15.53:3300/0 conn(0x7fb7e80c4750 0x7fb7e80c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 -- 172.21.15.53:0/2233259618 >> 172.21.15.53:0/2233259618 conn(0x7fb7e8067630 msgr2=0x7fb7e8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 -- 172.21.15.53:0/2233259618 shutdown_connections 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.828+0000 7fb7e7fff700 1 -- 172.21.15.53:0/2233259618 wait complete. 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.830+0000 7fb7e7fff700 1 Processor -- start 2023-09-28T00:24:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.830+0000 7fb7e7fff700 1 -- start start 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.830+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7e80c4750 0x7fb7e81696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.830+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 0x7fb7e814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c69a0 0x7fb7e80c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e7fff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e814e2a0 con 0x7fb7e80c56c0 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e7fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c96e0 con 0x7fb7e80c4750 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e7fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c0870 con 0x7fb7e80c69a0 2023-09-28T00:24:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 0x7fb7e814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 0x7fb7e814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34494/0 (socket says 172.21.15.53:34494) 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 -- 172.21.15.53:0/1916389252 learned_addr learned my addr 172.21.15.53:0/1916389252 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e77fe700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c69a0 0x7fb7e80c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e6ffd700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7e80c4750 0x7fb7e81696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 -- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c69a0 msgr2=0x7fb7e80c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c69a0 0x7fb7e80c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 -- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7e80c4750 msgr2=0x7fb7e81696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7e80c4750 0x7fb7e81696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 -- 172.21.15.53:0/1916389252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc009420 con 0x7fb7e80c56c0 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e77fe700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c69a0 0x7fb7e80c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e6ffd700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7e80c4750 0x7fb7e81696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.831+0000 7fb7e67fc700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 0x7fb7e814c7e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00ecb0 tx=0x7fb7dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.832+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc00c9d0 con 0x7fb7e80c56c0 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.832+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb7dc00cb30 con 0x7fb7e80c56c0 2023-09-28T00:24:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.832+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc00ced0 con 0x7fb7e80c56c0 2023-09-28T00:24:59.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.832+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8009420 con 0x7fb7e80c56c0 2023-09-28T00:24:59.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.832+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e0009ae0 con 0x7fb7e80c56c0 2023-09-28T00:24:59.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.833+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e806a950 con 0x7fb7e80c56c0 2023-09-28T00:24:59.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.834+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb7dc013680 con 0x7fb7e80c56c0 2023-09-28T00:24:59.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.835+0000 7fb7ceffd700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb7d4067360 0x7fb7d4069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:24:59.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.835+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6050+0+0 (secure 0 0 0) 0x7fb7dc084fe0 con 0x7fb7e80c56c0 2023-09-28T00:24:59.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.835+0000 7fb7e6ffd700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb7d4067360 0x7fb7d4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:24:59.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.836+0000 7fb7e6ffd700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb7d4067360 0x7fb7d4069810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80093f0 tx=0x7fb7d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:24:59.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:24:59.839+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb7dc055970 con 0x7fb7e80c56c0 2023-09-28T00:25:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.041+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7e8068b50 con 0x7fb7e80c56c0 2023-09-28T00:25:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.563+0000 7fb7ceffd700 1 -- 172.21.15.53:0/1916389252 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb7dc055500 con 0x7fb7e80c56c0 2023-09-28T00:25:00.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb7d4067360 msgr2=0x7fb7d4069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:25:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb7d4067360 0x7fb7d4069810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80093f0 tx=0x7fb7d8008040 comp rx=0 tx=0).stop 2023-09-28T00:25:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 msgr2=0x7fb7e814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:25:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 0x7fb7e814c7e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00ecb0 tx=0x7fb7dc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:25:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 shutdown_connections 2023-09-28T00:25:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:6832/120136,v1:172.21.15.118:6833/120136] conn(0x7fb7d4067360 0x7fb7d4069810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:25:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7e80c69a0 0x7fb7e80c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:25:00.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7e80c4750 0x7fb7e81696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:25:00.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 --2- 172.21.15.53:0/1916389252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e80c56c0 0x7fb7e814c7e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:25:00.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 >> 172.21.15.53:0/1916389252 conn(0x7fb7e8067630 msgr2=0x7fb7e815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:25:00.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.566+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 shutdown_connections 2023-09-28T00:25:00.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-28T00:25:00.567+0000 7fb7e7fff700 1 -- 172.21.15.53:0/1916389252 wait complete. 2023-09-28T00:25:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-09-28T00:25:00.586 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-28T00:25:00.587 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-28T00:25:00.587 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.600 INFO:tasks.ceph.mds.a:Stopped 2023-09-28T00:25:00.601 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-28T00:25:00.601 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.655 INFO:tasks.ceph.mds.c:Stopped 2023-09-28T00:25:00.655 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-09-28T00:25:00.655 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.710 INFO:tasks.ceph.mds.e:Stopped 2023-09-28T00:25:00.710 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-28T00:25:00.710 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.720 INFO:tasks.ceph.mds.b:Stopped 2023-09-28T00:25:00.721 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-28T00:25:00.721 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.771 INFO:tasks.ceph.mds.d:Stopped 2023-09-28T00:25:00.771 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-09-28T00:25:00.771 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.820 INFO:tasks.ceph.mds.f:Stopped 2023-09-28T00:25:00.821 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-28T00:25:00.821 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-28T00:25:00.821 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.860 INFO:tasks.ceph.osd.0:Stopped 2023-09-28T00:25:00.860 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-28T00:25:00.860 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.942 INFO:tasks.ceph.osd.1:Stopped 2023-09-28T00:25:00.942 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-28T00:25:00.942 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:00.991 INFO:tasks.ceph.osd.2:Stopped 2023-09-28T00:25:00.992 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-28T00:25:00.992 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.032 INFO:tasks.ceph.osd.3:Stopped 2023-09-28T00:25:01.032 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-28T00:25:01.033 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.072 INFO:tasks.ceph.osd.4:Stopped 2023-09-28T00:25:01.072 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-28T00:25:01.073 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.141 INFO:tasks.ceph.osd.5:Stopped 2023-09-28T00:25:01.142 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-28T00:25:01.142 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.218 INFO:tasks.ceph.osd.6:Stopped 2023-09-28T00:25:01.218 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-28T00:25:01.219 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.293 INFO:tasks.ceph.osd.7:Stopped 2023-09-28T00:25:01.294 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-28T00:25:01.294 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-28T00:25:01.294 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.352 INFO:tasks.ceph.mgr.y:Stopped 2023-09-28T00:25:01.353 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-28T00:25:01.353 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.380 INFO:tasks.ceph.mgr.x:Stopped 2023-09-28T00:25:01.380 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-28T00:25:01.380 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-28T00:25:01.380 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.399 INFO:tasks.ceph.mon.a:Stopped 2023-09-28T00:25:01.399 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-28T00:25:01.400 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.432 INFO:tasks.ceph.mon.b:Stopped 2023-09-28T00:25:01.432 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-28T00:25:01.432 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:25:01.483 INFO:tasks.ceph.mon.c:Stopped 2023-09-28T00:25:01.483 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-28T00:25:01.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-09-28T00:25:01.556 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:25:01.557 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-28T00:25:01.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:25:01.970 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-28T00:25:02.189 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:25:02.190 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-28T00:25:02.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:25:02.421 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-28T00:25:02.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:25:02.656 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-28T00:25:02.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:25:02.873 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-28T00:25:02.977 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:25:02.977 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-28T00:25:03.035 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:25:03.035 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-28T00:25:03.096 INFO:tasks.ceph:Archiving mon data... 2023-09-28T00:25:03.097 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/data/mon.a.tgz 2023-09-28T00:25:03.097 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-09-28T00:25:03.135 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.sqmG3lKUS4 2023-09-28T00:25:03.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sqmG3lKUS4 2023-09-28T00:25:03.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.sqmG3lKUS4 2023-09-28T00:25:03.401 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.sqmG3lKUS4 is 247KB 2023-09-28T00:25:03.489 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.sqmG3lKUS4 2023-09-28T00:25:03.525 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/data/mon.b.tgz 2023-09-28T00:25:03.525 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-09-28T00:25:03.540 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.tBz638kBqg 2023-09-28T00:25:03.541 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tBz638kBqg 2023-09-28T00:25:03.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.tBz638kBqg 2023-09-28T00:25:03.766 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.tBz638kBqg is 331KB 2023-09-28T00:25:03.860 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.tBz638kBqg 2023-09-28T00:25:03.874 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/data/mon.c.tgz 2023-09-28T00:25:03.874 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-09-28T00:25:03.927 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.wBIcV3QvBp 2023-09-28T00:25:03.927 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wBIcV3QvBp 2023-09-28T00:25:04.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.wBIcV3QvBp 2023-09-28T00:25:04.128 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.wBIcV3QvBp is 331KB 2023-09-28T00:25:04.222 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.wBIcV3QvBp 2023-09-28T00:25:04.235 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-28T00:25:04.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T00:25:04.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T00:25:04.301 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-28T00:25:04.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T00:25:04.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T00:25:04.361 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T00:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T00:25:04.400 INFO:tasks.ceph:Archiving crash dumps... 2023-09-28T00:25:04.402 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/remote/smithi053/crash 2023-09-28T00:25:04.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T00:25:04.464 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/remote/smithi118/crash 2023-09-28T00:25:04.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T00:25:04.488 INFO:tasks.ceph:Shutting down logrotate 2023-09-28T00:25:04.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:25:04.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:25:04.591 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-28T00:25:04.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-28T00:25:04.675 INFO:tasks.ceph:Compressing logs... 2023-09-28T00:25:04.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:25:04.680 DEBUG:teuthology.orchestra.run.smithi118:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:25:05.499 INFO:tasks.ceph:Archiving logs... 2023-09-28T00:25:05.499 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/remote/smithi053/log 2023-09-28T00:25:05.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T00:25:05.721 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/remote/smithi118/log 2023-09-28T00:25:05.722 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T00:25:05.833 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-28T00:25:05.856 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-28T00:25:05.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T00:25:05.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T00:25:05.969 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-28T00:25:05.977 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-28T00:25:05.978 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:25:05.982 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:25:05.995 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-09-28T00:25:05.999 INFO:teuthology.orchestra.run.smithi118.stdout:210 Number of sources = 4 2023-09-28T00:25:05.999 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:25:05.999 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-09-28T00:25:05.999 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 -421us[ -421us] +/- 78ms 2023-09-28T00:25:05.999 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -994us[ -996us] +/- 51ms 2023-09-28T00:25:05.999 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +2105us[+2105us] +/- 86ms 2023-09-28T00:25:06.000 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:25:06.012 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-09-28T00:25:06.017 INFO:teuthology.orchestra.run.smithi053.stdout:210 Number of sources = 4 2023-09-28T00:25:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:25:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-09-28T00:25:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 -407us[ -407us] +/- 79ms 2023-09-28T00:25:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -976us[ -978us] +/- 51ms 2023-09-28T00:25:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +2115us[+2115us] +/- 86ms 2023-09-28T00:25:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:25:06.019 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-28T00:25:06.031 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-28T00:25:06.032 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-28T00:25:06.082 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T00:25:06.247 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T00:25:06.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:25:06.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:25:06.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:25:06.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:25:06.430 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-28T00:25:06.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-28T00:25:06.482 INFO:teuthology.task.internal:Duration was 989.557709 seconds 2023-09-28T00:25:06.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-28T00:25:06.533 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-28T00:25:06.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T00:25:06.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T00:25:06.580 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:25:06.645 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:25:06.966 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-28T00:25:06.966 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2023-09-28T00:25:06.966 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T00:25:07.018 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T00:25:07.019 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T00:25:07.037 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-28T00:25:07.037 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:25:07.042 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:25:07.117 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-28T00:25:07.117 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T00:25:07.122 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T00:25:07.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-28T00:25:07.246 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-28T00:25:07.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T00:25:07.310 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T00:25:07.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-28T00:25:07.343 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:25:07.347 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:25:07.397 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-09-28T00:25:07.404 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2023-09-28T00:25:07.454 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:25:07.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:25:07.536 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:25:07.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:25:07.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-28T00:25:07.574 INFO:teuthology.task.internal:Transferring archived files... 2023-09-28T00:25:07.575 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/remote/smithi053 2023-09-28T00:25:07.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T00:25:07.648 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493/remote/smithi118 2023-09-28T00:25:07.648 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T00:25:07.681 INFO:teuthology.task.internal:Removing archive directory... 2023-09-28T00:25:07.681 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T00:25:07.686 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T00:25:07.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-28T00:25:07.741 INFO:teuthology.task.internal:Not uploading archives. 2023-09-28T00:25:07.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-28T00:25:07.776 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-28T00:25:07.776 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T00:25:07.781 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T00:25:07.794 INFO:teuthology.orchestra.run.smithi118.stdout: 262149 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 28 00:25 /home/ubuntu/cephtest 2023-09-28T00:25:07.813 INFO:teuthology.orchestra.run.smithi053.stdout: 524301 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 28 00:25 /home/ubuntu/cephtest 2023-09-28T00:25:07.813 INFO:teuthology.orchestra.run.smithi053.stdout: 527364 4 d--------- 2 ubuntu ubuntu 4096 Sep 28 00:23 /home/ubuntu/cephtest/mnt.0 2023-09-28T00:25:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-09-28T00:25:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-28T00:25:07.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:25:07.816 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi053 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T00:25:07.824 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-28T00:25:07.835 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-28T00:25:07.877 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi053 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T00:25:07.877 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T00:25:07.909 DEBUG:teuthology.nuke:shortname: smithi053 2023-09-28T00:25:07.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T00:25:07.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:59:41.009972', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHk+ADokjofcaAQ15aDVZR0SzTmNR+UFOQ9q5paoIYLZ6U59fptFsVBISPwCOiYvrLFgk3dVakmnDO6f++/la4g='} 2023-09-28T00:25:07.936 DEBUG:teuthology.nuke:shortname: smithi118 2023-09-28T00:25:07.936 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T00:25:07.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403493', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:59:41.008611', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoY1tr6orhKPGlK6PizELJ1WN+qAsxT1pCaJnEHgjiNVpuw09qV9ZhKEsEdkxLImgVvqsGtPcbyyc2wT85wl5M='} 2023-09-28T00:25:07.984 INFO:teuthology.orchestra.console.smithi053:Power off 2023-09-28T00:25:07.984 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T00:25:08.007 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-09-28T00:25:08.007 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:25:08.024 INFO:teuthology.orchestra.console.smithi118:Power off 2023-09-28T00:25:08.025 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T00:25:08.033 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-09-28T00:25:08.046 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-09-28T00:25:08.047 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:25:08.071 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-09-28T00:25:12.034 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:25:12.072 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:25:12.144 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-09-28T00:25:12.182 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-09-28T00:25:16.146 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:25:16.183 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:25:16.256 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-09-28T00:25:16.292 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-09-28T00:25:16.358 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-09-28T00:25:16.393 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-09-28T00:25:16.498 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} duration: 989.557708978653 failure_reason: '' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cda4fe37049048718c7813cf59701877 status: fail success: false 2023-09-28T00:25:16.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T00:25:16.589 INFO:teuthology.run:FAIL